00000001:02000400:2.0F:1787841657.796401:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787841675.796370:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787841678.079078:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 439 MB/s 00000001:01000000:0.0:1787841678.334401:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 780 MB/s 00000001:01000000:3.0F:1787841678.584672:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3972 MB/s 00000020:02000000:3.0:1787841679.538376:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_92_gffc8991 00000400:02000000:3.0:1787841680.667886:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.146@tcp [8/256/0/180] 00008000:02000000:1.0:1787841684.918237:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787841736.401104:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787841747.186818:0:5830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787841747.186825:0:5830:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787841747.186981:0:5830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c3bc37a7 00000080:02000400:2.0:1787841747.186992:0:5830:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787841747.192186:0:5830:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787841747.192205:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787841747.192258:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d259f334) 00000020:00000080:2.0:1787841747.192285:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787841747.238881:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787841747.239274:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787841747.299588:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787841747.299634:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787841747.299656:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787841747.299709:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787841747.299739:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787841747.305669:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787841747.305682:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787841747.305694:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135b92 00000020:01000004:3.0:1787841747.305703:0:5830:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787841747.305708:0:5830:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787841747.305713:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c3bc37a7 from MGS 00000020:01000004:3.0:1787841747.305719:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787841747.305756:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008802a2ce) 00000020:00000080:3.0:1787841747.305909:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787841747.305983:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3bc37a7 from MGS, refs=2 00080000:01000000:3.0:1787841747.305988:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787841747.305993:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135ba0 00000100:00100000:3.0:1787841747.322680:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787841747.323195:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787841747.323202:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787841747.330661:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787841747.330680:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787841747.331784:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841747.332005:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787841747.332027:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787841747.341414:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787841747.341431:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787841747.342041:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787841747.342048:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787841747.342767:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841747.342778:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841747.342780:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841747.343179:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841747.343181:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841747.343183:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841747.344030:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787841747.346919:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787841747.594440:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1567 MB/s 00000001:01000000:0.0:1787841747.844508:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2767 MB/s 00000001:01000000:0.0:1787841748.095365:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 743 MB/s 00000001:01000000:2.0:1787841748.345040:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 519 MB/s 00080000:10000000:3.0:1787841748.392920:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787841748.406742:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787841748.423886:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787841748.423909:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787841748.423912:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787841748.424742:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787841748.424808:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787841748.424866:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787841748.425089:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787841748.425130:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787841748.425441:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841748.425633:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787841748.425639:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787841748.426440:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787841748.426447:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787841748.443974:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787841748.443999:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787841748.451176:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787841748.451208:0:5830:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.146@tcp' 00000020:01000004:3.0:1787841748.451210:0:5830:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787841748.451278:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.146@tcp (typ=mgc) 00000020:00000080:3.0:1787841748.451293:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.146@tcp (00000000bd2d5d26) 00000020:00000080:3.0:1787841748.451312:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787841748.451407:0:5830:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004bb07684@MGC192.168.202.146@tcp: add connection 192.168.202.146@tcp at head 00010000:00010000:3.0:1787841748.451615:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.146@tcp-0 is initialized 00000040:01000000:3.0:1787841748.451622:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787841748.454059:0:5845:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787841748.472708:0:5847:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787841748.472826:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.146@tcp (uuid 907da169-f099-4269-9458-b15bc87a550d) 00000020:00000080:3.0:1787841748.472856:0:5830:0:(genops.c:1385:class_connect()) connect: client 907da169-f099-4269-9458-b15bc87a550d, cookie 0x1d0ed3605e135bae 00000100:00080000:3.0:1787841748.472872:0:5830:0:(import.c:510:import_select_connection()) MGC192.168.202.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841748.472879:0:5830:0:(import.c:624:import_select_connection()) MGC192.168.202.146@tcp: import 000000004bb07684 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:3.0:1787841748.472923:0:5830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000027ec6c2a x1874687877447808/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841748.472954:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 907da169-f099-4269-9458-b15bc87a550d->MGS 00000020:01000004:3.0:1787841748.472981:0:5830:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787841748.472986:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787841748.473003:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008ff209f3) 00000020:00000080:3.0:1787841748.473015:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787841748.476478:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027ec6c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:907da169-f099-4269-9458-b15bc87a550d:3305:1874687877447808:0@lo:250: 00000100:00100000:0.0:1787841748.476582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841748.478846:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877447808 00000100:00100000:1.0:1787841748.478862:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877447808 00000100:00100000:1.0:1787841748.478920:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841748.478927:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b67c9ee9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1874687877447808:12345-0@lo:250: 00010000:00080000:1.0:1787841748.478960:0:5841:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 907da169-f099-4269-9458-b15bc87a550d@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:1.0:1787841748.478990:0:5841:0:(genops.c:1385:class_connect()) connect: client 907da169-f099-4269-9458-b15bc87a550d, cookie 0x1d0ed3605e135bbc 00000100:00080000:1.0:1787841748.479163:0:5841:0:(import.c:65:import_set_state_nolock()) 000000007676b9b9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841748.479256:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b67c9ee9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+5:3305:x1874687877447808:12345-0@lo:250: Request processed in 327us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841748.479264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841748.481660:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787841748.481679:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.146@tcp: connect to target with instance 0 00000100:00080000:0.0:1787841748.481689:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787841748.481695:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787841748.481700:0:3305:0:(import.c:65:import_set_state_nolock()) 000000004bb07684 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787841748.481705:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787841748.481721:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787841748.481732:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027ec6c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:907da169-f099-4269-9458-b15bc87a550d:3305:1874687877447808:0@lo:250: 00000100:00100000:3.0:1787841748.505960:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841748.506232:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787841748.506239:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787841748.517338:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787841748.517354:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787841748.523188:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787841748.523207:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787841748.529208:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841748.529423:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787841748.529429:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787841748.530167:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787841748.530321:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787841748.615719:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841748.616319:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787841748.616335:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787841748.619160:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787841748.619175:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787841748.619917:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841748.620264:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787841748.620269:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787841748.620906:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787841748.620912:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787841748.622219:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841748.622430:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787841748.622436:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787841748.628353:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787841748.628368:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787841748.629727:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841748.630026:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787841748.630040:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787841748.631208:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787841748.631217:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787841748.653314:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841748.653718:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787841748.653726:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787841748.655827:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787841748.655842:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787841748.657445:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787841748.657557:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787841748.659058:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787841748.659087:0:5830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787841748.659094:0:5830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787841748.659271:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787841748.659315:0:5830:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.146@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787841748.659320:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787841748.659324:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841748.659325:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841748.659326:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841748.659327:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841748.659328:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841748.659330:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841748.659331:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841748.659333:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841748.659334:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841748.659335:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841748.659336:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841748.659339:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787841748.659341:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841748.659342:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841748.659343:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841748.659344:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841748.659345:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841748.659346:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841748.659347:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841748.659348:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841748.659349:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841748.659351:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841748.659351:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841748.659352:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841748.659392:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787841748.659409:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080688829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877447936:0@lo:253: 00000100:00100000:2.0:1787841748.660657:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841748.660930:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1abf809 going to sleep for 11 seconds 00000100:00100000:1.0:1787841748.660992:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877447936 00000100:00100000:1.0:1787841748.661002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877447936 00000100:00100000:1.0:1787841748.661049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841748.661057:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdc26aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+5:5830:x1874687877447936:12345-0@lo:253: 20000000:01000000:1.0:1787841748.661117:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787841748.661120:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787841748.661616:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787841748.661685:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787841748.662099:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787841748.663189:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787841748.663422:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787841748.663426:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787841748.663433:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787841748.663436:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787841748.663449:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787841748.663949:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841748.664209:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787841748.664223:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787841748.664271:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787841748.664311:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787841748.664343:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787841748.664423:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787841748.664431:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787841748.672871:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787841748.672908:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787841748.672997:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787841748.673004:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787841748.673029:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787841748.673104:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787841748.673196:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787841748.673205:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787841748.673221:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841748.673439:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787841748.673452:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787841748.674172:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787841748.674213:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787841748.674273:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787841748.674289:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787841748.675222:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787841748.675247:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787841748.675329:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787841748.675365:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787841748.675921:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787841748.675943:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787841748.676102:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787841748.676114:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787841748.676159:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787841748.676191:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787841748.676363:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787841748.676425:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787841748.676434:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787841748.677748:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787841748.678175:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787841748.678205:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.146@tcp for mdt 20000000:01000000:2.0:1787841748.678208:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.146@tcp (null) (null) (null) 00000040:00080000:2.0:1787841748.678239:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787841748.678246:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787841748.678270:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787841748.678276:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.146@tcp (null) (null) 00000040:00080000:2.0:1787841748.678312:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787841748.678321:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787841748.678348:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787841748.678398:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787841748.678501:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787841748.678505:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787841748.678509:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787841748.678535:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787841748.678538:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787841748.678584:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787841748.678586:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787841748.679692:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787841748.680053:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787841748.680093:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787841748.680166:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787841748.680179:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787841748.680181:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787841748.681192:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787841748.681450:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787841748.681529:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787841748.681576:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787841748.681597:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787841748.681600:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787841748.681605:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787841748.681608:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787841748.681615:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787841748.681634:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787841748.682270:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787841748.685419:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787841748.697227:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787841748.697322:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787841748.697393:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787841748.697423:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787841748.697447:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697850:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697862:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697869:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697876:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697883:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697889:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002bed8ec8 already unused, calling callback (00000000adddfdfe) 00010000:00010000:0.0:1787841748.697893:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697902:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697933:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697940:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841748.697946:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002bed8ec8/0x1d0ed3605e135bc3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787841748.697962:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787841748.989611:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdc26aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+5:5830:x1874687877447936:12345-0@lo:253: Request processed in 328543us (328949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841748.989635:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841748.989792:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080688829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877447936:0@lo:253: 10000000:01000000:2.0:1787841748.989811:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787841748.989816:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841748.989818:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841748.989830:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841748.989831:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787841748.989833:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841748.989835:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841748.989836:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841748.989838:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841748.989840:0:5830:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787841748.989841:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841748.989843:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787841748.989866:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c3bc37a7 from lustre-MDT0000 10000000:01000000:2.0:1787841748.989893:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787841748.989897:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787841748.989902:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9464871a4ed8 10000000:01000000:2.0:1787841748.989906:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787841748.989916:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9464871a4ed8 from 1 10000000:01000000:2.0:1787841748.989919:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787841748.989962:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841748.989974:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841748.989983:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841748.990002:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080688829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448064:0@lo:101: 00000100:00100000:2.0:1787841748.990043:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841748.990156:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbb204f7 going to sleep for 11 seconds 00000100:00100000:1.0:1787841748.990242:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448064 00000100:00100000:1.0:1787841748.990249:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448064 00000100:00100000:1.0:1787841748.990302:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841748.990309:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe64dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+5:5830:x1874687877448064:12345-0@lo:101: 00010000:00010000:1.0:1787841748.990325:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841748.990338:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ea6db6b/0x1d0ed3605e135bd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135bca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.990364:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ea6db6b/0x1d0ed3605e135bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.990375:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ea6db6b/0x1d0ed3605e135bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.990775:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ea6db6b, rc 0) 00000100:00100000:1.0:1787841748.990826:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe64dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+6:5830:x1874687877448064:12345-0@lo:101: Request processed in 517us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841748.990833:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841748.990856:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080688829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448064:0@lo:101: 00010000:00010000:2.0:1787841748.990871:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841748.990880:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841748.990951:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080688829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448192:0@lo:501: 00000100:00100000:2.0:1787841748.990977:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841748.991045:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbb204f7 going to sleep for 11 seconds 00000100:00100000:3.0:1787841748.991086:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448192 00000100:00100000:3.0:1787841748.991091:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448192 00000100:00100000:3.0:1787841748.991171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841748.991179:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065696670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+6:5830:x1874687877448192:12345-0@lo:501: 00000100:00100000:3.0:1787841748.991713:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065696670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+6:5830:x1874687877448192:12345-0@lo:501: Request processed in 533us (733us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841748.991721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841748.992633:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080688829 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448192:0@lo:501: 10000000:01000000:1.0:1787841748.992680:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787841748.992756:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.992789:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 00000000584ef608/0x1d0ed3605e135bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841748.992799:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946485cca000 10000000:01000000:1.0:1787841748.992805:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787841748.992811:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff946485cca000 10000000:01000000:1.0:1787841748.992813:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787841748.992817:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff946485cca000 from 1 10000000:01000000:1.0:1787841748.992819:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787841748.992852:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.992859:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.992870:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841748.992886:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000322282f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448320:0@lo:101: 00000100:00100000:1.0:1787841748.995578:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841748.995647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448320 00000100:00100000:2.0:1787841748.995659:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448320 00000100:00100000:1.0:1787841748.995665:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e24f6c22 going to sleep for 11 seconds 00000100:00100000:2.0:1787841748.995712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841748.995721:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005907354f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+6:5830:x1874687877448320:12345-0@lo:101: 00010000:00010000:2.0:1787841748.995742:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841748.995880:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bcd3a0f8/0x1d0ed3605e135bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135bd8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841748.995915:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcd3a0f8/0x1d0ed3605e135bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135bd8 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841748.995927:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bcd3a0f8/0x1d0ed3605e135bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135bd8 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841748.995936:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bcd3a0f8, rc 0) 00000100:00100000:2.0:1787841748.996010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005907354f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+7:5830:x1874687877448320:12345-0@lo:101: Request processed in 290us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841748.996017:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787841748.996117:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000322282f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448320:0@lo:101: 00010000:00010000:1.0:1787841748.996131:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.996138:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841748.996195:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787841748.998241:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.998261:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 0000000066042629/0x1d0ed3605e135bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841748.998271:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787841748.998281:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787841748.998289:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff946485cca000 10000000:01000000:1.0:1787841748.998293:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787841748.998297:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787841748.998300:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787841748.998343:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.998349:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.998361:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841748.998384:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000322282f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448448:0@lo:101: 00000100:00100000:1.0:1787841748.998998:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841748.999059:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e24f6c22 going to sleep for 11 seconds 00000100:00100000:3.0:1787841748.999191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448448 00000100:00100000:3.0:1787841748.999198:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448448 00000100:00100000:3.0:1787841748.999248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787841748.999256:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf73d19d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+7:5830:x1874687877448448:12345-0@lo:101: 00010000:00010000:3.0:1787841748.999289:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841748.999302:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b657a016/0x1d0ed3605e135bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135be6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841748.999323:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b657a016/0x1d0ed3605e135bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841748.999331:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b657a016/0x1d0ed3605e135bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841748.999337:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b657a016, rc 0) 00000100:00100000:3.0:1787841748.999382:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf73d19d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+8:5830:x1874687877448448:12345-0@lo:101: Request processed in 126us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841748.999399:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841748.999784:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000322282f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448448:0@lo:101: 00010000:00010000:1.0:1787841748.999801:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841748.999822:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841748.999893:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000322282f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448576:0@lo:501: 00000100:00100000:1.0:1787841748.999923:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841748.999957:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e24f6c22 going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.000018:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448576 00000100:00100000:2.0:1787841749.000024:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448576 00000100:00100000:2.0:1787841749.000067:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787841749.000073:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87cfbcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+8:5830:x1874687877448576:12345-0@lo:501: 00000100:00100000:2.0:1787841749.000646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87cfbcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+9:5830:x1874687877448576:12345-0@lo:501: Request processed in 571us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.000666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841749.001215:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000322282f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448576:0@lo:501: 00000100:00100000:3.0:1787841749.001266:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085582c99 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448704:0@lo:503: 00000100:00100000:3.0:1787841749.001334:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.001648:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8733fa2 going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.001713:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448704 00000100:00100000:2.0:1787841749.001721:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448704 00000100:00100000:2.0:1787841749.001813:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841749.001821:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eb7619b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+9:5830:x1874687877448704:12345-0@lo:503: 00000100:00100000:2.0:1787841749.002078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eb7619b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+9:5830:x1874687877448704:12345-0@lo:503: Request processed in 258us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.002086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841749.004300:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085582c99 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877448704:0@lo:503: 00000100:00100000:1.0:1787841749.005752:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5872:1874687877448832:0@lo:502: 00000100:00100000:1.0:1787841749.005898:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841749.005977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448832 00000100:00100000:2.0:1787841749.005985:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448832 00000100:00100000:2.0:1787841749.006049:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787841749.006058:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ad8ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+9:5872:x1874687877448832:12345-0@lo:502: 00000100:00100000:2.0:1787841749.006330:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ad8ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+9:5872:x1874687877448832:12345-0@lo:502: Request processed in 273us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.006339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841749.010855:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093b6b688 going to sleep for 11 seconds 00000100:00100000:1.0:1787841749.010914:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5872:1874687877448832:0@lo:502: 00000020:01000000:1.0:1787841749.010971:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841749.010986:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841749.010989:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787841749.010995:0:5872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787841749.010998:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841749.011050:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ecba9bdd) 00000020:00000080:1.0:1787841749.011075:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787841749.011082:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787841749.011236:0:5872:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787841749.011244:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135bfb 00000020:00000080:1.0:1787841749.013018:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787841749.013105:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841749.013114:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841749.013116:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787841749.013120:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841749.013126:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841749.013128:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787841749.013132:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841749.013171:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000031d61f48) 00000020:00000080:1.0:1787841749.013196:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787841749.013201:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787841749.013204:0:5872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787841749.013207:0:5872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787841749.013214:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787841749.013288:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3bc37a7 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787841749.013303:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002cd45035) 00000020:00000080:1.0:1787841749.013311:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787841749.013382:0:5872:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787841749.013676:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e135c10 00000020:00000080:1.0:1787841749.013940:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787841749.013947:0:5872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787841749.013953:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1d0ed3605e135c17 00080000:01000000:1.0:1787841749.013959:0:5872:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787841749.013963:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135c1e 00080000:10000000:2.0:1787841749.018288:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787841749.018997:0:5872:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787841749.027178:0:5872:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787841749.177648:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787841749.178279:0:5872:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787841749.181780:0:5872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787841749.182230:0:5872:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787841749.231172:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000bbbb54f6) 00000020:00000080:2.0:1787841749.231199:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787841749.231280:0:5872:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787841749.231287:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135c2c 00000020:00000080:2.0:1787841749.231912:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787841749.233742:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.278347:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.323360:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841749.360828:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.411133:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1787841749.425836:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787841749.464183:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787841749.538565:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1d0ed3605e135c33 00000020:00000080:0.0:1787841749.541176:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787841749.541195:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841749.541287:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841749.541290:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787841749.541295:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841749.541317:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841749.541318:0:5872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841749.541419:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841749.541420:0:5872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787841749.541424:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841749.541426:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841749.541427:0:5872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787841749.541430:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841749.541435:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841749.541436:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787841749.541440:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787841749.541572:0:5872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787841749.541655:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085582c99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5872:1874687877448960:0@lo:502: 00000100:00100000:3.0:1787841749.541893:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.542005:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000594b1ba5 going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.542118:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877448960 00000100:00100000:2.0:1787841749.542126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877448960 00000100:00100000:2.0:1787841749.542303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787841749.542312:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e50280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+9:5872:x1874687877448960:12345-0@lo:502: 00000100:00100000:3.0:1787841749.543279:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e50280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+9:5872:x1874687877448960:12345-0@lo:502: Request processed in 962us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.543290:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787841749.543563:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085582c99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5872:1874687877448960:0@lo:502: 00000020:01000000:0.0:1787841749.543600:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841749.543608:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841749.543610:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787841749.543614:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787841749.543900:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787841749.543921:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787841749.543969:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.543982:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 00000000baa81f46/0x1d0ed3605e135be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841749.543990:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946485cca000 from 1 10000000:01000000:3.0:1787841749.543993:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787841749.544031:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.544052:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.544061:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841749.544079:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449088:0@lo:101: 00000100:00100000:3.0:1787841749.544120:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.544165:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4f1b43c going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.544227:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449088 00000100:00100000:2.0:1787841749.544233:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449088 00000100:00100000:2.0:1787841749.544271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787841749.544277:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f732e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+9:5830:x1874687877449088:12345-0@lo:101: 00010000:00010000:2.0:1787841749.544289:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841749.544300:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135c3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.544340:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.544351:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.544360:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a20b6558, rc 0) 00000100:00100000:2.0:1787841749.544399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f732e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+10:5830:x1874687877449088:12345-0@lo:101: Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.544406:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841749.544585:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449088:0@lo:101: 00010000:00010000:3.0:1787841749.544597:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.544605:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841749.545238:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449216:0@lo:256: 00000100:00100000:3.0:1787841749.545282:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.545321:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4f1b43c going to sleep for 11 seconds 00000100:00100000:1.0:1787841749.545400:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449216 00000100:00100000:1.0:1787841749.545406:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449216 00000100:00100000:1.0:1787841749.545443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841749.545483:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aef667ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+10:5830:x1874687877449216:12345-0@lo:256: 20000000:01000000:1.0:1787841749.545502:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787841749.545509:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787841749.545573:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aef667ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+10:5830:x1874687877449216:12345-0@lo:256: Request processed in 123us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841749.545579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787841749.545719:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449216:0@lo:256: 10000000:01000000:3.0:1787841749.546309:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787841749.546995:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.547009:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841749.547036:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946485cca000 from 1 10000000:01000000:3.0:1787841749.547039:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841749.547069:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.547075:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.547085:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841749.547099:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449344:0@lo:101: 00000100:00100000:3.0:1787841749.547155:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.547185:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4f1b43c going to sleep for 11 seconds 00000100:00100000:1.0:1787841749.547307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449344 00000100:00100000:1.0:1787841749.547313:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449344 00000100:00100000:1.0:1787841749.547364:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841749.547372:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ae843e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+10:5830:x1874687877449344:12345-0@lo:101: 00010000:00010000:1.0:1787841749.547384:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841749.547404:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135c48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.547425:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.547436:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.547445:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a5a78fc, rc 0) 00000100:00100000:1.0:1787841749.547516:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ae843e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877449344:12345-0@lo:101: Request processed in 145us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841749.547523:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841749.547666:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449344:0@lo:101: 00010000:00010000:2.0:1787841749.547679:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.547687:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841749.547748:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfd4c793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449472:0@lo:501: 00000100:00100000:2.0:1787841749.547784:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841749.547813:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4aa0a3c going to sleep for 11 seconds 00000100:00100000:1.0:1787841749.547917:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449472 00000100:00100000:1.0:1787841749.547922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449472 00000100:00100000:1.0:1787841749.547950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841749.547956:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087f11c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877449472:12345-0@lo:501: 00000100:00100000:1.0:1787841749.548592:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087f11c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877449472:12345-0@lo:501: Request processed in 635us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841749.548600:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841749.548678:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfd4c793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449472:0@lo:501: 00000100:00100000:1.0:1787841749.548714:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449600:0@lo:503: 00000100:00100000:1.0:1787841749.549076:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.549099:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010b52a6e going to sleep for 11 seconds 00000100:00100000:1.0:1787841749.549117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449600 00000100:00100000:1.0:1787841749.549123:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449600 00000100:00100000:1.0:1787841749.549160:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841749.549168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d845e69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877449600:12345-0@lo:503: 00000040:00080000:1.0:1787841749.549215:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787841749.549253:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d845e69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877449600:12345-0@lo:503: Request processed in 87us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841749.549259:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841749.549300:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449600:0@lo:503: 00000040:00080000:2.0:1787841749.550566:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787841749.550847:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787841749.550868:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841749.551235:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.551250:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841749.551303:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787841749.551306:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946485cca000 10000000:01000000:1.0:1787841749.551309:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946485cca000 10000000:01000000:1.0:1787841749.551314:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787841749.551331:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946485cca000 from 1 10000000:01000000:1.0:1787841749.551335:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841749.551375:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.551383:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.551394:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841749.551417:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449728:0@lo:101: 00000100:00100000:1.0:1787841749.551717:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.551870:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058e5f56a going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.551986:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449728 00000100:00100000:2.0:1787841749.551995:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449728 00000100:00100000:2.0:1787841749.552045:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841749.552054:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec2a4966 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877449728:12345-0@lo:101: 00010000:00010000:2.0:1787841749.552071:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841749.552084:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e52a4340/0x1d0ed3605e135c5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135c56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.552109:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e52a4340/0x1d0ed3605e135c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.552121:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e52a4340/0x1d0ed3605e135c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.552130:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e52a4340, rc 0) 00000100:00100000:2.0:1787841749.552205:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec2a4966 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5830:x1874687877449728:12345-0@lo:101: Request processed in 152us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.552212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841749.552709:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449728:0@lo:101: 00010000:00010000:1.0:1787841749.552726:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841749.552735:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841749.552809:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449856:0@lo:501: 00000100:00100000:1.0:1787841749.552842:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.552867:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058e5f56a going to sleep for 11 seconds 00000100:00100000:3.0:1787841749.552990:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449856 00000100:00100000:3.0:1787841749.552995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449856 00000100:00100000:3.0:1787841749.553039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787841749.553048:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006111d982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5830:x1874687877449856:12345-0@lo:501: 00000100:00100000:3.0:1787841749.553348:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006111d982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5830:x1874687877449856:12345-0@lo:501: Request processed in 301us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.553355:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841749.553726:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449856:0@lo:501: 00000100:00100000:1.0:1787841749.553771:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449984:0@lo:503: 00000100:00100000:1.0:1787841749.553815:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.553841:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058e5f56a going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.554047:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877449984 00000100:00100000:2.0:1787841749.554053:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877449984 00000100:00100000:2.0:1787841749.554095:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841749.554103:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fca1ba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5830:x1874687877449984:12345-0@lo:503: 00000100:00100000:2.0:1787841749.554856:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fca1ba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5830:x1874687877449984:12345-0@lo:503: Request processed in 750us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.554875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841749.555293:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877449984:0@lo:503: 00000100:00100000:3.0:1787841749.555983:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5877:1874687877450112:0@lo:502: 00000100:00100000:3.0:1787841749.556170:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.556210:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 00000000594b1ba5 going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.556258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450112 00000100:00100000:2.0:1787841749.556264:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450112 00000100:00100000:2.0:1787841749.556309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787841749.556317:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b01ea87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5877:x1874687877450112:12345-0@lo:502: 00000100:00100000:2.0:1787841749.557161:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b01ea87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5877:x1874687877450112:12345-0@lo:502: Request processed in 843us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.557171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787841749.557871:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8fb63b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5877:1874687877450112:0@lo:502: 00000020:01000004:1.0:1787841749.557950:0:5877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787841749.557968:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e4c93aea) 00000020:00000080:1.0:1787841749.557991:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787841749.558158:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3bc37a7 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787841749.558162:0:5877:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c3bc37a7 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787841749.558165:0:5877:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c3bc37a7 4 00010000:00080000:1.0:1787841749.558197:0:5877:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067ce94f9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.146@tcp at head 00010000:00010000:1.0:1787841749.565861:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787841749.566089:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787841749.566125:0:5877:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787841749.566149:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1d0ed3605e135c6b 00000100:00080000:1.0:1787841749.566161:0:5877:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787841749.566165:0:5877:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067ce94f9 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:1.0:1787841749.566203:0:5877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cee43aa8 x1874687877450240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787841749.566229:0:5877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787841749.573606:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877450240:0@lo:38: 00000100:00100000:2.0:1787841749.573734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.573997:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450240 00000100:00100000:1.0:1787841749.574005:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450240 00000100:00100000:1.0:1787841749.574057:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841749.574065:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb79a672 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874687877450240:12345-0@lo:38: 00000100:00100000:1.0:1787841749.574130:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb79a672 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874687877450240:12345-0@lo:38: Request processed in 64us (396us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787841749.574148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841749.574190:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787841749.574197:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000067ce94f9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787841749.574201:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787841749.574204:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877450240:0@lo:38: 00000100:00100000:1.0:1787841749.575147:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5877:1874687877450368:0@lo:502: 00000100:00100000:1.0:1787841749.575220:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.575264:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 000000001150423e going to sleep for 11 seconds 00000100:00100000:2.0:1787841749.575363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450368 00000100:00100000:2.0:1787841749.575369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450368 00000100:00100000:2.0:1787841749.575419:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841749.575426:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6f00a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5877:x1874687877450368:12345-0@lo:502: 00000100:00100000:2.0:1787841749.575696:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6f00a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5877:x1874687877450368:12345-0@lo:502: Request processed in 269us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841749.575705:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787841749.576235:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee43aa8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:5877:1874687877450368:0@lo:502: 00000040:00080000:1.0:1787841749.576267:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787841749.576575:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787841749.576596:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787841749.576617:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.576629:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 00000000ecd2b5bf/0x1d0ed3605e135c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787841749.576679:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787841749.576681:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841749.576686:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841749.576687:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841749.576688:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841749.576689:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841749.576690:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841749.576692:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841749.576693:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841749.576694:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841749.576696:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841749.576697:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787841749.576700:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787841749.576703:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841749.576704:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841749.576705:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841749.576706:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841749.576707:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841749.576708:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841749.576709:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841749.576710:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841749.576710:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841749.576711:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841749.576712:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841749.576713:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787841749.576731:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787841749.576742:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050387905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877450496:0@lo:253: 00000100:00100000:2.0:1787841749.576861:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841749.576891:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7ed043b going to sleep for 11 seconds 00000100:00100000:3.0:1787841749.576951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450496 00000100:00100000:3.0:1787841749.576957:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450496 00000100:00100000:3.0:1787841749.576999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787841749.577007:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1ad08ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5830:x1874687877450496:12345-0@lo:253: 20000000:01000000:3.0:1787841749.577107:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787841749.577123:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787841749.644811:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787841749.644870:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787841749.645008:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787841749.645013:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787841749.645110:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.645133:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.645152:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.645222:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.645239:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 12 pid: 5841 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841749.645255:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efd4e94c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874687877450624:0@lo:104: 00000100:00100000:2.0:1787841749.645330:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841749.645538:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d40039c7 going to sleep for 11 seconds 00000100:00100000:0.0:1787841749.647716:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450624 00000100:00100000:0.0:1787841749.647734:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450624 00000100:00100000:0.0:1787841749.647826:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841749.647835:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010077bc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5865:x1874687877450624:12345-0@lo:104: 00010000:00010000:0.0:1787841749.647858:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841749.647953:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841749.647958:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010077bc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5865:x1874687877450624:12345-0@lo:104: Request processed in 125us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841749.647974:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787841749.647998:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841749.648003:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841749.648012:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3b1838f already unused, calling callback (000000001fd0b7a7) 10000000:00010000:0.0:1787841749.648015:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841749.648155:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efd4e94c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874687877450624:0@lo:104: 00010000:00010000:1.0:1787841749.648180:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841749.648278:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841749.648286:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841749.648292:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787841749.648335:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841749.648341:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787841749.648444:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000089db7fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877450752:0@lo:103: 00000100:00100000:3.0:1787841749.648516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841749.648761:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841749.648770:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: 00000000e3b1838f/0x1d0ed3605e135c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c41 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841749.648794:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841749.648796:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841749.648797:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841749.649207:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450752 00000100:00100000:3.0:1787841749.649215:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450752 00010000:00010000:3.0:1787841749.649240:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 13 pid: 5841 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841749.649275:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841749.649283:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085582c99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+13:3307:x1874687877450752:12345-0@lo:103: 00010000:00010000:3.0:1787841749.649295:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841749.649299:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 13 pid: 5841 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649311:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 13 pid: 5841 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649326:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a20b6558/0x1d0ed3605e135c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135c3a expref: 13 pid: 5841 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649340:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649348:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787841749.649362:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004349849s 00010000:00010000:3.0:1787841749.649373:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649380:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649653:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649660:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649666:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016129c29 already unused, calling callback (00000000adddfdfe) 00010000:00010000:3.0:1787841749.649669:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.649677:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.654908:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841749.654934:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.655107:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.655120:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016129c29/0x1d0ed3605e135c72 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841749.655173:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841749.655312:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085582c99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+12:3307:x1874687877450752:12345-0@lo:103: Request processed in 6025us (6792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.655324:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841749.655416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1ad08ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5830:x1874687877450496:12345-0@lo:253: Request processed in 78410us (78555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.655425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787841749.655715:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050387905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:5830:1874687877450496:0@lo:253: 10000000:01000000:2.0:1787841749.655731:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787841749.655735:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841749.655736:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841749.655738:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841749.655739:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841749.655740:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841749.655742:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841749.655743:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841749.655745:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841749.655746:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841749.655760:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841749.655761:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841749.655763:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787841749.655779:0:5830:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787841749.657876:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000089db7fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877450752:0@lo:103: 00080000:10000000:3.0:1787841749.662427:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787841749.663013:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787841749.663326:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787841749.663705:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787841749.664011:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.669192:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841749.670334:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.670653:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841749.670945:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.671222:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841749.671419:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841749.671711:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787841749.710294:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787841749.746588:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787841749.746857:0:5882:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787841749.746862:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787841749.747015:0:5883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787841749.752027:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787841749.752216:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787841749.754835:0:5830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787841749.754958:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787841749.755307:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841749.757555:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787841749.758118:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787841749.758163:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787841749.758446:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787841749.760093:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787841749.763545:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787841749.763726:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787841749.763986:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787841749.764248:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787841749.764433:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787841749.764680:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787841749.764935:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787841749.765077:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787841749.765257:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787841749.765395:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787841749.765651:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787841749.765885:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787841749.766028:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787841749.766178:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787841749.766338:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787841749.766518:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787841749.767005:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787841749.767183:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787841749.767390:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787841749.767967:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787841749.768181:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787841749.768360:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787841749.768637:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787841749.768870:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787841749.769038:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787841749.769197:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787841749.769340:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787841749.769965:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787841749.770902:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787841749.771028:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787841749.771173:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787841749.771313:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787841749.771912:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787841749.781412:0:5883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787841749.829603:0:5830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787841749.829672:0:5830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb8cac1c63988 00100000:10000000:3.0:1787841749.829683:0:5830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787841749.832344:0:5830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787841749.832366:0:5830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787841749.832381:0:5830:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787841749.832416:0:5830:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787841749.837381:0:5883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787841749.839948:0:5883:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787841749.839957:0:5883:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787841750.450832:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841751.487453:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841752.497753:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841753.526301:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841754.546732:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787841754.615619:0:6126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787841754.869482:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787841754.869494:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787841754.869497:0:38:0:(import.c:65:import_set_state_nolock()) 0000000067ce94f9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841754.869512:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067ce94f9 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:2.0:1787841754.869536:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000104161b4 x1874687877451008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787841754.869592:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000104161b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877451008:0@lo:38: 00000100:00100000:2.0:1787841754.869663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841754.869963:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3d3ebce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877450880:0@lo:400: 00000100:00100000:0.0:1787841754.870000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841754.870070:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451008 00000100:00100000:0.0:1787841754.870077:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451008 00000100:00100000:0.0:1787841754.870121:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841754.870128:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c525bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874687877451008:12345-0@lo:38: 00010000:00080000:0.0:1787841754.870155:0:5851:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:0.0:1787841754.870193:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1d0ed3605e135c79 00000004:00100000:0.0:1787841754.870256:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787841754.870443:0:5851:0:(import.c:65:import_set_state_nolock()) 0000000061d54c5d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841754.870510:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c525bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874687877451008:12345-0@lo:38: Request processed in 382us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841754.870517:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787841754.870531:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000104161b4 x1874687877451008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787841754.870548:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787841754.870555:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787841754.870559:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787841754.870561:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000067ce94f9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787841754.870566:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000104161b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877451008:0@lo:38: 00000100:00100000:1.0:1787841754.872008:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877450880 00000100:00100000:1.0:1787841754.872023:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877450880 00000100:00100000:1.0:1787841754.872075:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841754.872085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002095ac88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+11:3308:x1874687877450880:12345-0@lo:400: 00000100:00100000:1.0:1787841754.872174:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002095ac88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+11:3308:x1874687877450880:12345-0@lo:400: Request processed in 91us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841754.872182:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787841754.873754:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3d3ebce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877450880:0@lo:400: 10000000:01000000:0.0:1787841755.379413:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787841755.379424:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946485cca000 from 3 10000000:01000000:0.0:1787841755.379431:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787841755.379509:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841755.379524:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841755.379551:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841755.379581:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000089db7fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451136:0@lo:101: 00000100:00100000:0.0:1787841755.379665:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841755.379717:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac6ce203 going to sleep for 11 seconds 00000100:00100000:3.0:1787841755.379807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451136 00000100:00100000:3.0:1787841755.379815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451136 00000100:00100000:3.0:1787841755.379874:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841755.379883:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa697ee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:5847:x1874687877451136:12345-0@lo:101: 00010000:00010000:3.0:1787841755.379898:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841755.379913:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6c0ee5f/0x1d0ed3605e135c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135c80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841755.379938:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6c0ee5f/0x1d0ed3605e135c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841755.379948:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6c0ee5f/0x1d0ed3605e135c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841755.379958:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6c0ee5f, rc 0) 00000100:00100000:3.0:1787841755.380000:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa697ee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877451136:12345-0@lo:101: Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841755.380007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787841755.380323:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000089db7fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451136:0@lo:101: 00010000:00010000:2.0:1787841755.380339:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841755.380348:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841755.380412:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e6455fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451264:0@lo:256: 00000100:00100000:2.0:1787841755.380446:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841755.380504:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca4cd6e8 going to sleep for 11 seconds 00000100:00100000:3.0:1787841755.380577:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451264 00000100:00100000:3.0:1787841755.380586:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451264 00000100:00100000:3.0:1787841755.380616:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841755.380623:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030a0924e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877451264:12345-0@lo:256: 20000000:01000000:3.0:1787841755.380637:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787841755.380652:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787841755.380656:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787841755.380736:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030a0924e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877451264:12345-0@lo:256: Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841755.380742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787841755.380809:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e6455fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451264:0@lo:256: 10000000:01000000:0.0:1787841755.380873:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787841755.380888:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841755.380897:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: 00000000552e67ec/0x1d0ed3605e135c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841755.571638:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841756.593685:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841757.618808:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841758.641721:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841759.665633:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787841759.673240:0:6329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe08b672f0 20000000:00000080:2.0:1787841759.673260:0:6329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94648a7cc400 uarg=0000000000000000 20000000:01000000:2.0:1787841759.673301:0:6329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787841759.673309:0:6329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787841759.673314:0:6329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787841759.673763:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787841759.673775:0:6329:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787841759.679421:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787841759.679900:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787841759.679992:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787841759.680060:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787841759.680081:0:6329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787841759.680104:0:6329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.680127:0:6329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.680135:0:6329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.680191:0:6329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.680207:0:6329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 11 pid: 5842 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841759.680221:0:6329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000529b6ce2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1874687877451392:0@lo:104: 00000100:00100000:2.0:1787841759.680295:0:6329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.680351:0:6329:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e93ef02 going to sleep for 11 seconds 00000100:00100000:3.0:1787841759.680494:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451392 00000100:00100000:3.0:1787841759.680502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451392 00000100:00100000:3.0:1787841759.680545:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841759.680553:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e6455fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:6329:x1874687877451392:12345-0@lo:104: 00010000:00010000:3.0:1787841759.680565:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680619:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787841759.680624:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e6455fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:6329:x1874687877451392:12345-0@lo:104: Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841759.680631:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787841759.680649:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841759.680654:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680661:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004b652e58 already unused, calling callback (000000001fd0b7a7) 10000000:00010000:3.0:1787841759.680664:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680672:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841759.680685:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841759.680691:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787841759.680717:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680723:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841759.680736:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680743:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: 000000004b652e58/0x1d0ed3605e135c48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680762:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841759.680764:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841759.680765:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841759.680782:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027ec6c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877451520:0@lo:103: 00000100:00100000:3.0:1787841759.680809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841759.680846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451520 00000100:00100000:3.0:1787841759.680849:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451520 00010000:00010000:3.0:1787841759.680862:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 12 pid: 5842 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841759.680882:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841759.680887:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1cf678 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+12:3309:x1874687877451520:12345-0@lo:103: 00010000:00010000:3.0:1787841759.680897:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841759.680901:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 12 pid: 5842 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680919:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 12 pid: 5842 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680936:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680944:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680957:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680964:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680970:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680976:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.680981:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005ba0b436 already unused, calling callback (00000000adddfdfe) 00010000:00010000:3.0:1787841759.681106:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.681114:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.681122:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841759.681142:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841759.681178:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1cf678 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+12:3309:x1874687877451520:12345-0@lo:103: Request processed in 291us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841759.681184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841759.681218:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027ec6c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877451520:0@lo:103: 00010000:00010000:2.0:1787841759.681407:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a5a78fc/0x1d0ed3605e135c4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135c48 expref: 11 pid: 5842 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841759.681428:0:6329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000529b6ce2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1874687877451392:0@lo:104: 00010000:00010000:2.0:1787841759.681439:0:6329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.681447:0:6329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.681452:0:6329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841759.681474:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ba0b436/0x1d0ed3605e135c8e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841759.985933:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006631965e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877451648:0@lo:400: 00000100:00100000:1.0:1787841759.986026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841759.986505:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451648 00000100:00100000:0.0:1787841759.986515:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451648 00000100:00100000:0.0:1787841759.986562:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841759.986569:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f143e53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877451648:12345-0@lo:400: 00000100:00100000:0.0:1787841759.986641:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f143e53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877451648:12345-0@lo:400: Request processed in 72us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841759.986648:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787841759.986797:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006631965e x1874687877451648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841759.986814:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006631965e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877451648:0@lo:400: 00010000:00010000:2.0:1787841760.689644:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841761.718781:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787841762.673526:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841762.673534:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946485cca000 from 1 10000000:01000000:3.0:1787841762.673540:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841762.673586:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: 0000000086d01bda/0x1d0ed3605e135c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841762.673600:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: 0000000086d01bda/0x1d0ed3605e135c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841762.673612:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: 0000000086d01bda/0x1d0ed3605e135c95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841762.673636:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027ec6c2a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451776:0@lo:101: 00000100:00100000:3.0:1787841762.673713:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841762.673765:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000154856b5 going to sleep for 11 seconds 00000100:00100000:0.0:1787841762.674506:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451776 00000100:00100000:0.0:1787841762.674533:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451776 00000100:00100000:0.0:1787841762.674590:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841762.674597:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069aa6b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+11:5847:x1874687877451776:12345-0@lo:101: 00010000:00010000:0.0:1787841762.674614:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841762.674628:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c953e04/0x1d0ed3605e135c9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135c95 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841762.674657:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c953e04/0x1d0ed3605e135c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841762.674668:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c953e04/0x1d0ed3605e135c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841762.674677:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c953e04, rc 0) 00000100:00100000:0.0:1787841762.674727:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069aa6b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877451776:12345-0@lo:101: Request processed in 131us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841762.674734:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841762.674794:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027ec6c2a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451776:0@lo:101: 00010000:00010000:0.0:1787841762.674810:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: 0000000086d01bda/0x1d0ed3605e135c95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841762.674819:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: 0000000086d01bda/0x1d0ed3605e135c95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841762.674875:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f16ba65 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451904:0@lo:501: 00000100:00100000:0.0:1787841762.674902:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841762.674917:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064a44d2a going to sleep for 11 seconds 00000100:00100000:0.0:1787841762.674929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877451904 00000100:00100000:0.0:1787841762.674933:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877451904 00000100:00100000:0.0:1787841762.674960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841762.674965:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f77afe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877451904:12345-0@lo:501: 00000100:00100000:0.0:1787841762.675219:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f77afe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877451904:12345-0@lo:501: Request processed in 253us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841762.675226:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841762.675254:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f16ba65 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877451904:0@lo:501: 00000100:00100000:0.0:1787841762.675295:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f16ba65 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877452032:0@lo:503: 00000100:00100000:0.0:1787841762.675329:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841762.675341:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064a44d2a going to sleep for 11 seconds 00000100:00100000:0.0:1787841762.675353:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452032 00000100:00100000:0.0:1787841762.675356:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452032 00000100:00100000:0.0:1787841762.675375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787841762.675380:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af954958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877452032:12345-0@lo:503: 00000100:00100000:0.0:1787841762.675587:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af954958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877452032:12345-0@lo:503: Request processed in 206us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841762.675595:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787841762.675637:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f16ba65 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877452032:0@lo:503: 00000100:00100000:0.0:1787841762.675810:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f16ba65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6536:1874687877452160:0@lo:502: 00000100:00100000:0.0:1787841762.675840:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841762.675859:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452160 00000100:00100000:0.0:1787841762.675862:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452160 00000100:00100000:0.0:1787841762.675892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841762.675898:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015cec8f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:6536:x1874687877452160:12345-0@lo:502: 00000100:00100000:0.0:1787841762.676020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015cec8f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:6536:x1874687877452160:12345-0@lo:502: Request processed in 122us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841762.676203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841762.676230:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea6f4ddd going to sleep for 11 seconds 00000100:00100000:0.0:1787841762.676242:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f16ba65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6536:1874687877452160:0@lo:502: 00000020:01000000:0.0:1787841762.676262:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841762.676270:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841762.676273:0:6536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787841762.676280:0:6536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946485cca000 00000020:00000080:0.0:1787841762.676282:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787841762.676323:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6536:1874687877452288:0@lo:502: 00000100:00100000:0.0:1787841762.676354:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841762.676374:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452288 00000100:00100000:0.0:1787841762.676378:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452288 00000100:00100000:0.0:1787841762.676397:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841762.676403:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:6536:x1874687877452288:12345-0@lo:502: 00000100:00100000:0.0:1787841762.676524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:6536:x1874687877452288:12345-0@lo:502: Request processed in 120us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841762.676530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841762.676617:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485137480 going to sleep for 11 seconds 00000100:00100000:0.0:1787841762.676629:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6536:1874687877452288:0@lo:502: 00000020:01000000:0.0:1787841762.676646:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841762.676650:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841762.676651:0:6536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787841762.676655:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787841762.676707:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787841762.676723:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841762.676732:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841762.676752:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841762.738880:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841763.762909:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841764.787500:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841765.105928:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877452416:0@lo:400: 00000100:00100000:0.0:1787841765.105929:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877452544:0@lo:400: 00000100:00100000:0.0:1787841765.109389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841765.111441:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452544 00000100:00100000:2.0:1787841765.114356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841765.115327:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452544 00000100:00100000:2.0:1787841765.115522:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841765.115533:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877452544:12345-0@lo:400: 00000100:00100000:2.0:1787841765.115618:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877452544:12345-0@lo:400: Request processed in 87us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841765.115626:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841765.115727:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452416 00000100:00100000:0.0:1787841765.115733:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452416 00000100:00100000:0.0:1787841765.115778:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787841765.115788:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:3307:x1874687877452416:12345-0@lo:400: 00000100:00100000:0.0:1787841765.115838:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:3307:x1874687877452416:12345-0@lo:400: Request processed in 53us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841765.115846:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787841765.115911:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946493291a40 x1874687877452544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841765.115928:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877452544:0@lo:400: 00000100:00100000:0.0:1787841765.115962:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877452416:0@lo:400: 00010000:00010000:3.0:1787841765.812319:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787841766.432347:0:6689:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787841766.432358:0:6689:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787841766.432797:0:6689:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946486706000 00000020:01000004:2.0:1787841766.432819:0:6689:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787841766.432833:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787841766.432849:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff946484e60000) 00000020:00000080:2.0:1787841766.432867:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787841766.486916:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787841766.487360:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787841766.560567:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787841766.569293:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787841766.569344:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787841766.569404:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787841766.569431:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787841766.569833:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787841766.569845:0:6689:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787841766.569856:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d0ed3605e135caa 00000020:01000004:3.0:1787841766.569865:0:6689:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787841766.569888:0:6689:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787841766.569891:0:6689:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787841766.569896:0:6689:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787841766.569900:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787841766.569913:0:6689:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9464871a0000) 00000020:00000080:3.0:1787841766.569924:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787841766.570984:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841766.571158:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787841766.571164:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787841766.589929:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787841766.589946:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787841766.590380:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787841766.590387:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787841766.592999:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841766.593224:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787841766.593231:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787841766.598100:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787841766.598129:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787841766.661112:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841766.661369:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787841766.661375:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787841766.681546:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787841766.681564:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787841766.688448:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787841766.688488:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787841766.704437:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841766.705319:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787841766.705327:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787841766.706410:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787841766.706419:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787841766.808177:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841766.808415:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787841766.808422:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787841766.809763:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787841766.809775:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787841766.810191:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787841766.810215:0:6689:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787841766.810222:0:6689:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787841766.839118:0:6689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787841766.839172:0:6689:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.146@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787841766.839176:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787841766.839178:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841766.839179:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841766.839180:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841766.839182:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841766.839183:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841766.839184:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841766.839186:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841766.839187:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841766.839189:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841766.839190:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841766.839194:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787841766.839196:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841766.839197:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841766.839199:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841766.839200:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841766.839201:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841766.839202:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841766.839203:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841766.839204:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841766.839205:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841766.839211:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841766.839211:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841766.839242:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787841766.839261:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877452672:0@lo:253: 00000100:00100000:2.0:1787841766.839341:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841766.839392:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a70316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841766.839551:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452672 00000100:00100000:0.0:1787841766.839559:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452672 00000100:00100000:0.0:1787841766.839632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787841766.839642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877452672:12345-0@lo:253: 20000000:01000000:0.0:1787841766.839676:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787841766.839681:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787841766.839694:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787841766.839697:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787841766.840677:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841766.840909:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787841766.840922:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787841766.840962:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787841766.840970:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787841766.841014:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787841766.841060:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787841766.841430:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787841766.841451:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.146@tcp 20000000:01000000:0.0:1787841766.841453:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.146@tcp (null) (null) (null) 00000040:00080000:0.0:1787841766.841518:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787841766.841526:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787841766.841585:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787841766.841594:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.146@tcp (null) (null) 00000040:00080000:0.0:1787841766.841629:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787841766.841639:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787841766.841668:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787841766.841719:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787841766.842415:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787841766.842432:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.146@tcp 20000000:01000000:0.0:1787841766.842434:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.146@tcp (null) (null) (null) 00000040:00080000:0.0:1787841766.842492:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787841766.842500:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787841766.842527:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787841766.842533:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.146@tcp (null) (null) 00000040:00080000:0.0:1787841766.842578:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787841766.842586:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787841766.842612:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787841766.842640:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787841766.842654:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787841766.842662:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787841766.842666:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787841766.842680:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787841766.842683:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787841766.842718:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787841766.842721:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00010000:00010000:1.0:1787841766.845620:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787841766.850799:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787841766.850898:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787841766.850956:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787841766.851513:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787841766.851874:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787841766.851955:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787841766.851972:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787841766.851976:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787841766.854926:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787841766.855038:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787841766.855090:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787841766.856075:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787841766.856126:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787841766.856163:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787841766.856176:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787841766.856179:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787841766.860071:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787841766.862793:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787841766.862851:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787841766.862929:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787841766.862948:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787841766.862950:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787841766.862959:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787841766.862993:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863015:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863024:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863030:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863059:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863104:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863120:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 12 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.863136:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877452800:0@lo:104: 00000100:00100000:2.0:1787841766.863207:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787841766.863282:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863291:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 12 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.863300:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877452928:0@lo:104: 00000100:00100000:2.0:1787841766.863321:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787841766.863340:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.863348:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 12 pid: 5842 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.863357:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877453056:0@lo:104: 00000100:00100000:2.0:1787841766.863375:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841766.863385:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a7031b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841766.863495:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452800 00000100:00100000:1.0:1787841766.863504:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452800 00000100:00100000:1.0:1787841766.863559:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877452928 00000100:00100000:1.0:1787841766.863562:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877452928 00000100:00100000:1.0:1787841766.863573:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453056 00000100:00100000:1.0:1787841766.863574:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453056 00000100:00100000:1.0:1787841766.863588:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841766.863608:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+5:5841:x1874687877452800:12345-0@lo:104: 00010000:00010000:1.0:1787841766.863623:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863685:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841766.863692:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+5:5841:x1874687877452800:12345-0@lo:104: Request processed in 96us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.863700:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841766.863717:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841766.863723:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+4:5841:x1874687877452928:12345-0@lo:104: 00010000:00010000:1.0:1787841766.863729:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863759:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787841766.863763:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+4:5841:x1874687877452928:12345-0@lo:104: Request processed in 41us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.863768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841766.863778:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787841766.863783:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5841:x1874687877453056:12345-0@lo:104: 00010000:00010000:1.0:1787841766.863789:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863846:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787841766.863851:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5841:x1874687877453056:12345-0@lo:104: Request processed in 68us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.863857:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787841766.863873:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787841766.863879:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863886:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841766.863890:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863899:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841766.863906:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841766.863912:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841766.863941:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863947:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841766.863961:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.863968:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864003:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787841766.864007:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864012:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499c00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841766.864014:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864020:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841766.864026:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841766.864030:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841766.864044:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864050:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841766.864063:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864069:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481499c00/0x1d0ed3605e135be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135bed expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864079:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841766.864082:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864100:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841766.864103:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864110:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841766.864116:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841766.864121:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841766.864135:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864141:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841766.864146:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864153:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464c2045400/0x1d0ed3605e135bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135bd1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.864167:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841766.864168:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841766.864170:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841766.864377:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841766.864401:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877453184:0@lo:103: 00000100:00100000:0.0:1787841766.864436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841766.864499:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877453440:0@lo:103: 00000100:00100000:0.0:1787841766.864519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841766.864546:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841766.864553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877453312:0@lo:103: 00000100:00100000:0.0:1787841766.864573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841766.864614:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453184 00000100:00100000:0.0:1787841766.864618:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453184 00010000:00010000:0.0:1787841766.864642:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 13 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841766.864660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453440 00000100:00100000:0.0:1787841766.864662:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453440 00010000:00010000:0.0:1787841766.864674:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 14 pid: 5842 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841766.864683:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453312 00000100:00100000:0.0:1787841766.864692:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453312 00010000:00010000:0.0:1787841766.864715:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 15 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841766.864729:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841766.864735:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+15:3309:x1874687877453184:12345-0@lo:103: 00010000:00010000:0.0:1787841766.864746:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841766.864751:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 15 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864762:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 15 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864778:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841766.864809:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+15:3309:x1874687877453184:12345-0@lo:103: Request processed in 74us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841766.864814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841766.864829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841766.864834:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+14:3307:x1874687877453440:12345-0@lo:103: 00010000:00010000:0.0:1787841766.864841:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841766.864845:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 14 pid: 5842 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864851:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 14 pid: 5842 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864860:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841766.864883:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+14:3307:x1874687877453440:12345-0@lo:103: Request processed in 49us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841766.864888:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841766.864908:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841766.864914:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+13:3307:x1874687877453312:12345-0@lo:103: 00010000:00010000:0.0:1787841766.864921:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841766.864925:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 13 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864934:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 13 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864945:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864953:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864966:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864973:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864980:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.864996:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.865001:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841766.865006:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.865014:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.865029:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.865041:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841766.865063:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+13:3307:x1874687877453312:12345-0@lo:103: Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841766.865069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841766.865106:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877453184:0@lo:103: 00000100:00100000:0.0:1787841766.865131:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877453312:0@lo:103: 00000100:00100000:0.0:1787841766.865138:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877453440:0@lo:103: 00010000:00010000:2.0:1787841766.865661:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135c56 expref: 12 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.865684:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877452800:0@lo:104: 00010000:00010000:2.0:1787841766.865699:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135be6 expref: 11 pid: 5844 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.865707:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877452928:0@lo:104: 00010000:00010000:2.0:1787841766.865715:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481498400/0x1d0ed3605e135bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135bca expref: 10 pid: 5842 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.865722:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877453056:0@lo:104: 00010000:00010000:2.0:1787841766.865739:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.865748:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.865754:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.865760:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2045e00/0x1d0ed3605e135cb8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787841766.865773:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787841766.963981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+9:6689:x1874687877452672:12345-0@lo:253: Request processed in 124328us (124627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.964007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841766.964218:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877452672:0@lo:253: 10000000:01000000:2.0:1787841766.964237:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787841766.964240:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841766.964242:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841766.964243:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841766.964245:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787841766.964264:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841766.964265:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841766.964267:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841766.964268:0:6689:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787841766.964270:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841766.964272:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787841766.964293:0:6689:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946486706000 from lustre-OST0000 10000000:01000000:2.0:1787841766.964326:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787841766.964330:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787841766.964338:0:6689:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9464871a4ed8 local copy 10000000:01000000:2.0:1787841766.964343:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787841766.964387:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.964399:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.964409:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.964429:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453568:0@lo:101: 00000100:00100000:2.0:1787841766.964490:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841766.964569:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a7031900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841766.964736:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453568 00000100:00100000:0.0:1787841766.964743:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453568 00000100:00100000:0.0:1787841766.964792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787841766.964801:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+9:6689:x1874687877453568:12345-0@lo:101: 00010000:00010000:0.0:1787841766.964816:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841766.964830:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480e00/0x1d0ed3605e135cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135cbf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.964856:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480e00/0x1d0ed3605e135cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135cbf expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.964867:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480e00/0x1d0ed3605e135cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135cbf expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.964877:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480e00, rc 0) 00000100:00100000:0.0:1787841766.964923:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+10:6689:x1874687877453568:12345-0@lo:101: Request processed in 124us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841766.964940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787841766.965023:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453568:0@lo:101: 00010000:00010000:3.0:1787841766.965037:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.965047:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841766.965864:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453696:0@lo:501: 00000100:00100000:3.0:1787841766.965905:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.965938:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841766.966142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453696 00000100:00100000:1.0:1787841766.966148:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453696 00000100:00100000:1.0:1787841766.966197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787841766.966206:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+10:6689:x1874687877453696:12345-0@lo:501: 00000100:00100000:1.0:1787841766.966448:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+10:6689:x1874687877453696:12345-0@lo:501: Request processed in 243us (541us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787841766.966477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841766.966952:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453696:0@lo:501: 10000000:01000000:3.0:1787841766.966973:0:6689:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787841766.967016:0:6689:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787841766.967024:0:6689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967034:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967042:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967066:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787841766.967090:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946486706000 10000000:01000000:3.0:1787841766.967096:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787841766.967101:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9464871a4ed8 10000000:01000000:3.0:1787841766.967104:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787841766.967107:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9464871a4ed8 from 1 10000000:01000000:3.0:1787841766.967110:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787841766.967135:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967143:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967167:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841766.967182:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453824:0@lo:101: 00000100:00100000:3.0:1787841766.967213:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.967254:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841766.967333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453824 00000100:00100000:2.0:1787841766.967339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453824 00000100:00100000:2.0:1787841766.967371:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787841766.967379:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+10:6689:x1874687877453824:12345-0@lo:101: 00010000:00010000:2.0:1787841766.967389:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841766.967402:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135cd4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135ccd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.967424:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135cd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135ccd expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.967442:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135cd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135ccd expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.967451:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2045800, rc 0) 00000100:00100000:2.0:1787841766.967516:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877453824:12345-0@lo:101: Request processed in 138us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841766.967522:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787841766.967805:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453824:0@lo:101: 00010000:00010000:3.0:1787841766.967819:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967828:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841766.967847:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787841766.967863:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967871:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841766.967878:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787841766.967882:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787841766.967887:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787841766.967890:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787841766.967907:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967914:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.967930:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841766.967942:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453952:0@lo:101: 00000100:00100000:3.0:1787841766.967970:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.968007:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bc00 going to sleep for 11 seconds 00010000:00010000:1.0:1787841766.968323:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841766.968332:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.968340:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841766.968344:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.968353:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841766.968360:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841766.968366:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841766.968389:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.968395:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841766.968424:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.968431:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135cbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d0ed3605e135cc6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841766.968492:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841766.968495:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841766.968497:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841766.968564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877453952 00000100:00100000:2.0:1787841766.968569:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877453952 00000100:00100000:2.0:1787841766.968767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787841766.968777:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877453952:12345-0@lo:101: 00010000:00010000:2.0:1787841766.968787:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841766.968797:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135cdb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.968817:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.968827:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.968835:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044c00, rc 0) 00000100:00100000:2.0:1787841766.968875:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877453952:12345-0@lo:101: Request processed in 99us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841766.968881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787841766.968943:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841766.968956:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877454080:0@lo:103: 00000100:00100000:3.0:1787841766.968998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.969039:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454080 00000100:00100000:3.0:1787841766.969043:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454080 00000100:00100000:3.0:1787841766.969075:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841766.969082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c911680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+12:3309:x1874687877454080:12345-0@lo:103: 00010000:00010000:3.0:1787841766.969092:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841766.969104:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480e00/0x1d0ed3605e135cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135cbf expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.969115:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841766.969141:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c911680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+11:3309:x1874687877454080:12345-0@lo:103: Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841766.969147:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841766.969178:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877454080:0@lo:103: 00000100:00100000:3.0:1787841766.969207:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877453952:0@lo:101: 00010000:00010000:3.0:1787841766.969218:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841766.969238:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841766.969342:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454208:0@lo:501: 00000100:00100000:3.0:1787841766.969366:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.970357:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841766.970475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454208 00000100:00100000:1.0:1787841766.970482:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454208 00000100:00100000:1.0:1787841766.970523:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787841766.970532:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454208:12345-0@lo:501: 00000100:00100000:1.0:1787841766.971348:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454208:12345-0@lo:501: Request processed in 813us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.971357:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787841766.971451:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454208:0@lo:501: 00000100:00100000:3.0:1787841766.971522:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454336:0@lo:503: 00000100:00100000:3.0:1787841766.971575:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.971607:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841766.971741:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454336 00000100:00100000:2.0:1787841766.971746:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454336 00000100:00100000:2.0:1787841766.971775:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787841766.971788:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454336:12345-0@lo:503: 00000100:00100000:2.0:1787841766.971945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454336:12345-0@lo:503: Request processed in 158us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841766.971952:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787841766.972114:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454336:0@lo:503: 00000040:00080000:3.0:1787841766.972370:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787841766.972438:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454464:0@lo:502: 00000100:00100000:3.0:1787841766.972498:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.972517:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841766.972626:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454464 00000100:00100000:2.0:1787841766.972630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454464 00000100:00100000:2.0:1787841766.972655:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787841766.972661:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454464:12345-0@lo:502: 00000100:00100000:2.0:1787841766.972786:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454464:12345-0@lo:502: Request processed in 124us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841766.972792:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787841766.972959:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454464:0@lo:502: 00000040:00080000:3.0:1787841766.973215:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787841766.973273:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787841766.973306:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787841766.973347:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787841766.973384:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787841766.973414:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787841766.973435:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454592:0@lo:502: 00000100:00100000:3.0:1787841766.973974:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841766.974127:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841766.974193:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454592 00000100:00100000:0.0:1787841766.974202:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454592 00000100:00100000:1.0:1787841766.974261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787841766.974272:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454592:12345-0@lo:502: 00000100:00100000:3.0:1787841766.974575:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454592:0@lo:502: 00000040:00080000:3.0:1787841766.974698:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787841766.974710:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787841766.975310:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787841766.975319:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787841766.975325:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841766.975327:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787841766.975331:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787841766.975360:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9464bfa2ced8) 00000020:00000080:3.0:1787841766.975385:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787841766.975392:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787841766.975483:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946486706000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787841766.975491:0:6708:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787841766.975500:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d0ed3605e135cf0 00000100:00100000:1.0:1787841766.976739:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454592:12345-0@lo:502: Request processed in 187us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.976753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1787841766.979519:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787841766.981091:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787841766.983922:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787841766.984256:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787841766.990092:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787841766.990889:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787841766.992531:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787841766.994936:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841766.994952:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841766.994954:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787841766.994959:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841766.994964:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841766.994965:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841766.994969:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841766.994971:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787841766.995053:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841766.995056:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841766.995058:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787841766.995074:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787841766.995309:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787841766.995339:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787841766.995367:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.995381:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841766.995389:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946486706000 from 1 10000000:01000000:2.0:1787841766.995392:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787841766.995435:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.995443:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.995486:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.995525:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454720:0@lo:101: 00000100:00100000:2.0:1787841766.995700:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841766.995763:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a7031f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841766.997884:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454720 00000100:00100000:0.0:1787841766.997900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454720 00000100:00100000:0.0:1787841766.997978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787841766.997999:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+11:6689:x1874687877454720:12345-0@lo:101: 00010000:00010000:0.0:1787841766.998020:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841766.998041:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135cf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.998076:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.998088:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841766.998098:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481200, rc 0) 00000100:00100000:0.0:1787841766.998176:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877454720:12345-0@lo:101: Request processed in 180us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841766.998182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787841766.998589:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454720:0@lo:101: 00010000:00010000:2.0:1787841766.999239:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841766.999253:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841766.999396:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454848:0@lo:501: 00000100:00100000:2.0:1787841766.999450:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841767.000752:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a7031f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841767.001061:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454848 00000100:00100000:1.0:1787841767.001072:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454848 00000100:00100000:1.0:1787841767.001124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787841767.001135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877454848:12345-0@lo:501: 00000100:00100000:1.0:1787841767.001545:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877454848:12345-0@lo:501: Request processed in 399us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841767.001555:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787841767.004915:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454848:0@lo:501: 00000100:00100000:3.0:1787841767.004994:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454976:0@lo:503: 00000100:00100000:3.0:1787841767.005078:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.005117:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841767.005177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877454976 00000100:00100000:1.0:1787841767.005183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877454976 00000100:00100000:1.0:1787841767.005237:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787841767.005246:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877454976:12345-0@lo:503: 00000100:00100000:0.0:1787841767.005835:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877454976:12345-0@lo:503: Request processed in 587us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.005847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787841767.005941:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877454976:0@lo:503: 00000040:00080000:3.0:1787841767.006500:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787841767.006585:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455104:0@lo:502: 00000100:00100000:3.0:1787841767.006712:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.006750:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841767.006835:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455104 00000100:00100000:0.0:1787841767.006841:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455104 00000100:00100000:0.0:1787841767.006887:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787841767.006896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877455104:12345-0@lo:502: 00000100:00100000:0.0:1787841767.007105:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877455104:12345-0@lo:502: Request processed in 210us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.007113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787841767.007256:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455104:0@lo:502: 00000040:00080000:3.0:1787841767.007780:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787841767.007838:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787841767.007866:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455232:0@lo:502: 00000100:00100000:3.0:1787841767.007909:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.007944:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841767.008150:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455232 00000100:00100000:0.0:1787841767.008156:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455232 00000100:00100000:0.0:1787841767.008202:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787841767.008210:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877455232:12345-0@lo:502: 00000100:00100000:0.0:1787841767.008364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877455232:12345-0@lo:502: Request processed in 154us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.008373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787841767.008531:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455232:0@lo:502: 00000040:00080000:3.0:1787841767.008750:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787841767.008763:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787841767.011211:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841767.011224:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841767.011226:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787841767.011235:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946486706000 00000020:00000080:2.0:1787841767.011238:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787841767.011256:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841767.011259:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841767.011261:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787841767.011264:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787841767.011399:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787841767.011426:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841767.011589:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.011676:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841767.011729:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787841767.011733:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946486706000 10000000:01000000:3.0:1787841767.011736:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946486706000 10000000:01000000:3.0:1787841767.011740:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787841767.011746:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946486706000 from 1 10000000:01000000:3.0:1787841767.011748:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787841767.011789:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.011797:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.011810:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841767.011834:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455360:0@lo:101: 00000100:00100000:3.0:1787841767.011910:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.011994:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841767.012057:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455360 00000100:00100000:1.0:1787841767.012064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455360 00000100:00100000:1.0:1787841767.012136:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787841767.012146:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877455360:12345-0@lo:101: 00010000:00010000:1.0:1787841767.012161:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841767.012173:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135d05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841767.012198:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841767.012211:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841767.012221:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499c00, rc 0) 00000100:00100000:1.0:1787841767.012265:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455360:12345-0@lo:101: Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841767.012272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787841767.012337:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455360:0@lo:101: 00010000:00010000:3.0:1787841767.012353:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.012363:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841767.012491:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455488:0@lo:501: 00000100:00100000:3.0:1787841767.012516:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.012832:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841767.012884:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455488 00000100:00100000:0.0:1787841767.012889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455488 00000100:00100000:0.0:1787841767.012912:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841767.012919:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455488:12345-0@lo:501: 00000100:00100000:0.0:1787841767.013167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455488:12345-0@lo:501: Request processed in 248us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.013175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787841767.013285:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455488:0@lo:501: 00000100:00100000:3.0:1787841767.013314:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455616:0@lo:503: 00000100:00100000:3.0:1787841767.013353:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.013373:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841767.013418:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455616 00000100:00100000:0.0:1787841767.013423:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455616 00000100:00100000:0.0:1787841767.013450:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787841767.013483:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455616:12345-0@lo:503: 00000100:00100000:3.0:1787841767.013864:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455616:12345-0@lo:503: Request processed in 407us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841767.013872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787841767.013955:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455616:0@lo:503: 00000040:00080000:0.0:1787841767.014280:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787841767.014340:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455744:0@lo:502: 00000100:00100000:0.0:1787841767.014380:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841767.014449:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787841767.014587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455744 00000100:00100000:2.0:1787841767.014592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455744 00000100:00100000:1.0:1787841767.014839:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787841767.014896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455744:12345-0@lo:502: 00000100:00100000:0.0:1787841767.015100:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455744:12345-0@lo:502: Request processed in 252us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.015107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787841767.015195:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455744:0@lo:502: 00000040:00080000:1.0:1787841767.015430:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787841767.015898:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787841767.015938:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787841767.016000:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787841767.016040:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787841767.016105:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787841767.016139:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787841767.016173:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787841767.016218:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787841767.016256:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787841767.016288:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787841767.016335:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787841767.016370:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787841767.016406:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787841767.016481:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787841767.016523:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787841767.016558:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787841767.016810:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787841767.016853:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787841767.016886:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787841767.016937:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787841767.016973:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787841767.017021:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787841767.017071:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787841767.017109:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787841767.017140:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787841767.017187:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787841767.017222:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787841767.017273:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455872:0@lo:502: 00000100:00100000:2.0:1787841767.017350:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841767.017682:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a7031840 going to sleep for 11 seconds 00000100:00100000:3.0:1787841767.017843:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877455872 00000100:00100000:3.0:1787841767.017851:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877455872 00000100:00100000:3.0:1787841767.017893:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787841767.017904:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455872:12345-0@lo:502: 00000100:00100000:3.0:1787841767.018152:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877455872:12345-0@lo:502: Request processed in 249us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841767.018160:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787841767.018254:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877455872:0@lo:502: 00000040:00080000:2.0:1787841767.018344:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787841767.018355:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787841767.019329:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787841767.019346:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9464bfa2b490) 00000020:00000080:3.0:1787841767.019371:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787841767.019486:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946486706000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787841767.019491:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946486706000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787841767.019493:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946486706000 3 00010000:00080000:3.0:1787841767.019524:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94638127a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.146@tcp at head 00010000:00010000:3.0:1787841767.021141:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787841767.022740:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787841767.022783:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787841767.022804:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1d0ed3605e135d1a 00000100:00080000:2.0:1787841767.022817:0:6713:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787841767.022824:0:6713:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94638127a000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:2.0:1787841767.022866:0:6713:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464932e43c0 x1874687877456000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787841767.022901:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787841767.023083:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874687877456000:0@lo:38: 00000100:00100000:0.0:1787841767.023161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841767.023228:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841767.023236:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877456128:0@lo:400: 00000100:00100000:0.0:1787841767.023261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841767.023293:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456000 00000100:00100000:0.0:1787841767.023300:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456000 00000100:00100000:0.0:1787841767.023324:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456128 00000100:00100000:0.0:1787841767.023327:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456128 00000100:00100000:0.0:1787841767.023350:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841767.023358:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877456128:12345-0@lo:400: 00000100:00100000:0.0:1787841767.023412:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877456128:12345-0@lo:400: Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.023419:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841767.023433:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841767.023436:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874687877456000:12345-0@lo:38: 00010000:00080000:0.0:1787841767.023496:0:5849:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1787841767.023526:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1d0ed3605e135d21 00000004:00100000:0.0:1787841767.023542:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787841767.023574:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9464b9645800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841767.023683:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874687877456000:12345-0@lo:38: Request processed in 244us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.023690:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787841767.023750:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9464932e4000 x1874687877456128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841767.023763:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877456128:0@lo:400: 00010000:00080000:0.0:1787841767.023788:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9464932e43c0 x1874687877456000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841767.023796:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787841767.023802:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787841767.023809:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787841767.023813:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787841767.023815:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94638127a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787841767.023821:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874687877456000:0@lo:38: 00000040:00080000:0.0:1787841767.024267:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787841767.025527:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787841767.025565:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787841767.026079:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841767.026093:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787841767.026151:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787841767.026153:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841767.026154:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841767.026155:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841767.026156:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841767.026158:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841767.026159:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841767.026161:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841767.026162:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841767.026164:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841767.026165:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787841767.026168:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787841767.026171:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841767.026172:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841767.026173:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841767.026174:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841767.026175:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841767.026177:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841767.026177:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841767.026178:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841767.026179:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841767.026185:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841767.026186:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787841767.026213:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787841767.026230:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877456256:0@lo:253: 00000100:00100000:2.0:1787841767.026303:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841767.026353:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a7031480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841767.028877:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456256 00000100:00100000:3.0:1787841767.028892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456256 00000100:00100000:3.0:1787841767.028943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787841767.028953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:6689:x1874687877456256:12345-0@lo:253: 20000000:01000000:3.0:1787841767.028998:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787841767.029022:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787841767.071331:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787841767.071353:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787841767.073936:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787841767.073948:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787841767.073977:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.074009:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.074019:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.074068:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841767.074085:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 13 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841767.074100:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874687877456384:0@lo:104: 00000100:00100000:3.0:1787841767.074178:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841767.074231:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841767.074338:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456384 00000100:00100000:0.0:1787841767.074346:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456384 00000100:00100000:0.0:1787841767.074401:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841767.074411:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c912d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5865:x1874687877456384:12345-0@lo:104: 00010000:00010000:0.0:1787841767.074425:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074510:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841767.074517:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c912d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5865:x1874687877456384:12345-0@lo:104: Request processed in 108us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.074524:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787841767.074547:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841767.074554:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074585:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841767.074589:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074608:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841767.074615:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841767.074621:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787841767.074655:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074662:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841767.074683:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074690:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135c80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c87 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074707:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841767.074709:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841767.074711:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841767.074732:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877456512:0@lo:103: 00000100:00100000:0.0:1787841767.074765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841767.074801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456512 00000100:00100000:0.0:1787841767.074805:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456512 00010000:00010000:0.0:1787841767.074823:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 14 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841767.074854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841767.074861:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648709e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+14:3306:x1874687877456512:12345-0@lo:103: 00010000:00010000:0.0:1787841767.074873:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841767.074878:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 14 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074890:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 14 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074908:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074916:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787841767.074931:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004349849s 00010000:00010000:0.0:1787841767.074937:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074944:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074951:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074958:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074964:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841767.074968:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.074993:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.075004:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.075015:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841767.075044:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648709e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+14:3306:x1874687877456512:12345-0@lo:103: Request processed in 184us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841767.075052:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841767.075124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877456512:0@lo:103: 00010000:00010000:0.0:1787841767.075153:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135c87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135c80 expref: 13 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841767.075165:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874687877456384:0@lo:104: 00010000:00010000:0.0:1787841767.075178:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.075187:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.075194:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841767.075200:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841767.085370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:6689:x1874687877456256:12345-0@lo:253: Request processed in 56404us (59054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841767.085385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787841767.085623:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:6689:1874687877456256:0@lo:253: 10000000:01000000:3.0:1787841767.085643:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787841767.085647:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787841767.085649:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787841767.085651:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787841767.085652:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787841767.085653:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787841767.085655:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787841767.085657:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787841767.085659:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787841767.085660:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787841767.085662:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787841767.085679:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787841767.085702:0:6689:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787841767.098217:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841767.098422:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841767.098812:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841767.099025:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841767.099213:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841767.100863:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787841767.106941:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787841767.437928:0:6689:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787841767.437934:0:6689:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787841767.438007:0:6689:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787841767.438070:0:6689:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787841767.438084:0:6689:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787841767.438113:0:6689:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787841767.857713:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841768.881756:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841769.905710:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841770.930142:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841771.955864:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841772.281382:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877456640:0@lo:400: 00000100:00100000:0.0:1787841772.281493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787841772.281703:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787841772.281708:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946485cca000 from 21 10000000:01000000:1.0:1787841772.281713:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841772.281757:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.281797:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.281813:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841772.281830:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457024:0@lo:101: 00000100:00100000:1.0:1787841772.281860:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841772.289379:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877456896:0@lo:400: 00000100:00100000:2.0:1787841772.289493:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841772.289778:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877456768:0@lo:400: 00000100:00100000:2.0:1787841772.289808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841772.290108:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456640 00000100:00100000:0.0:1787841772.290127:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456640 00000100:00100000:0.0:1787841772.290174:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457024 00000100:00100000:0.0:1787841772.290178:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457024 00000100:00100000:0.0:1787841772.290194:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787841772.290204:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:3307:x1874687877456640:12345-0@lo:400: 00000100:00100000:1.0:1787841772.290307:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841772.290328:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787841772.290337:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:5847:x1874687877457024:12345-0@lo:101: 00010000:00010000:1.0:1787841772.290350:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841772.290371:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135d2f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.290404:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.290416:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.290426:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:1.0:1787841772.290474:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457024:12345-0@lo:101: Request processed in 138us (8612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841772.290481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787841772.290532:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457024:0@lo:101: 00010000:00010000:1.0:1787841772.290548:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.290587:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841772.290658:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457152:0@lo:501: 00000100:00100000:1.0:1787841772.290683:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841772.290703:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841772.290713:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457152 00000100:00100000:1.0:1787841772.290716:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457152 00000100:00100000:1.0:1787841772.290733:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787841772.290738:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457152:12345-0@lo:501: 00000100:00100000:1.0:1787841772.291401:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457152:12345-0@lo:501: Request processed in 658us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841772.291412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787841772.291453:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457152:0@lo:501: 00000100:00100000:1.0:1787841772.291517:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457280:0@lo:503: 00000100:00100000:1.0:1787841772.292308:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841772.292349:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841772.292375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457280 00000100:00100000:1.0:1787841772.292382:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457280 00000100:00100000:1.0:1787841772.292416:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787841772.292424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457280:12345-0@lo:503: 00000100:00100000:0.0:1787841772.292614:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:3307:x1874687877456640:12345-0@lo:400: Request processed in 2409us (11118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.292623:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787841772.292663:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456896 00000100:00100000:0.0:1787841772.292667:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456896 00000100:00100000:0.0:1787841772.292711:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877456768 00000100:00100000:0.0:1787841772.292714:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877456768 00000100:00100000:0.0:1787841772.292727:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841772.292733:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877456896:12345-0@lo:400: 00000100:00100000:0.0:1787841772.292783:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877456896:12345-0@lo:400: Request processed in 51us (3292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.292789:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841772.292799:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841772.292805:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877456768:12345-0@lo:400: 00000100:00100000:0.0:1787841772.292832:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877456768:12345-0@lo:400: Request processed in 27us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.292844:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841772.292889:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493291a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877456640:0@lo:400: 00010000:00080000:0.0:1787841772.292959:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493290000 x1874687877456896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841772.292974:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877456896:0@lo:400: 00010000:00080000:2.0:1787841772.294219:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493293480 x1874687877456768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841772.294234:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877456768:0@lo:400: 00000100:00080000:2.0:1787841772.294272:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841772.294756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:5847:x1874687877457280:12345-0@lo:503: Request processed in 2328us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841772.294766:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787841772.295035:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457280:0@lo:503: 00000100:00100000:0.0:1787841772.302168:0:6919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6919:1874687877457408:0@lo:502: 00000100:00100000:0.0:1787841772.302263:0:6919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.302333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457408 00000100:00100000:3.0:1787841772.302340:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457408 00000100:00100000:3.0:1787841772.302393:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787841772.302402:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:6919:x1874687877457408:12345-0@lo:502: 00000100:00100000:0.0:1787841772.302599:0:6919:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841772.302757:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:6919:x1874687877457408:12345-0@lo:502: Request processed in 355us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841772.302766:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787841772.303045:0:6919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6919:1874687877457408:0@lo:502: 00000100:00100000:0.0:1787841772.303106:0:6919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6919:1874687877457536:0@lo:502: 00000100:00100000:0.0:1787841772.303154:0:6919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841772.303189:0:6919:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841772.303392:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457536 00000100:00100000:3.0:1787841772.303399:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457536 00000100:00100000:3.0:1787841772.303437:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787841772.303445:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:6919:x1874687877457536:12345-0@lo:502: 00000100:00100000:3.0:1787841772.303753:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:6919:x1874687877457536:12345-0@lo:502: Request processed in 308us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841772.303760:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787841772.303905:0:6919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6919:1874687877457536:0@lo:502: 00000040:00080000:0.0:1787841772.303930:0:6919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787841772.304224:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787841772.304252:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787841772.304265:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.304276:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841772.304285:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787841772.304288:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946485cca000 from 4 10000000:01000000:3.0:1787841772.304291:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787841772.304397:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.304417:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.304428:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841772.304445:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457664:0@lo:101: 00000100:00100000:3.0:1787841772.304720:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.304789:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.309047:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457664 00000100:00100000:0.0:1787841772.309068:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457664 00000100:00100000:1.0:1787841772.310102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787841772.310126:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:5847:x1874687877457664:12345-0@lo:101: 00010000:00010000:1.0:1787841772.310158:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841772.310181:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135d3d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.310216:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.310229:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.310239:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499a00, rc 0) 00000100:00100000:1.0:1787841772.310320:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457664:12345-0@lo:101: Request processed in 199us (5601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841772.310328:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787841772.310399:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457664:0@lo:101: 00010000:00010000:0.0:1787841772.310422:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841772.310432:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841772.310992:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457792:0@lo:256: 00000100:00100000:0.0:1787841772.311055:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.316642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457792 00000100:00100000:3.0:1787841772.316660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457792 00000100:00100000:3.0:1787841772.316721:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787841772.316729:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457792:12345-0@lo:256: 20000000:01000000:3.0:1787841772.316761:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787841772.316782:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787841772.316785:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787841772.316905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457792:12345-0@lo:256: Request processed in 175us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841772.316913:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787841772.320598:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841772.320642:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457792:0@lo:256: 10000000:01000000:1.0:1787841772.320710:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787841772.320723:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.320734:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841772.320744:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787841772.320747:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787841772.320749:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787841772.320787:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.320806:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841772.320817:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841772.320836:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457920:0@lo:101: 00000100:00100000:1.0:1787841772.320892:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841772.322239:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841772.322683:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877457920 00000100:00100000:3.0:1787841772.322693:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877457920 00000100:00100000:3.0:1787841772.322759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787841772.322769:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877457920:12345-0@lo:101: 00010000:00010000:3.0:1787841772.322788:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841772.322807:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135d4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.322837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.322858:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.322867:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dd800, rc 0) 00000100:00100000:3.0:1787841772.323016:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877457920:12345-0@lo:101: Request processed in 248us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841772.323033:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787841772.323218:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877457920:0@lo:101: 00010000:00010000:3.0:1787841772.323237:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841772.323248:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841772.323314:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458048:0@lo:501: 00000100:00100000:3.0:1787841772.323346:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.323378:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.323496:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458048 00000100:00100000:0.0:1787841772.323500:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458048 00000100:00100000:0.0:1787841772.323537:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787841772.323545:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877458048:12345-0@lo:501: 00000100:00100000:0.0:1787841772.323859:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877458048:12345-0@lo:501: Request processed in 314us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.323867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787841772.325335:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458048:0@lo:501: 00000100:00100000:3.0:1787841772.325395:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458176:0@lo:503: 00000100:00100000:3.0:1787841772.325500:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.325533:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841772.325774:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458176 00000100:00100000:1.0:1787841772.325781:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458176 00000100:00100000:1.0:1787841772.325827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841772.325837:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877458176:12345-0@lo:503: 00000100:00100000:1.0:1787841772.326517:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877458176:12345-0@lo:503: Request processed in 677us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841772.326527:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787841772.326536:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458176:0@lo:503: 00000100:00100000:1.0:1787841772.331848:0:6920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6920:1874687877458304:0@lo:502: 00000100:00100000:1.0:1787841772.331975:0:6920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841772.332024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458304 00000100:00100000:1.0:1787841772.332028:0:6920:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648923e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.332031:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458304 00000100:00100000:0.0:1787841772.332082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787841772.332093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:6920:x1874687877458304:12345-0@lo:502: 00000100:00100000:0.0:1787841772.333222:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:6920:x1874687877458304:12345-0@lo:502: Request processed in 1124us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.333234:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787841772.333606:0:6920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6920:1874687877458304:0@lo:502: 00000020:01000000:1.0:1787841772.333661:0:6920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787841772.333671:0:6920:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787841772.333678:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841772.333681:0:6920:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787841772.333686:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787841772.333690:0:6920:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.146@tcp to nid 0x20000c0a8ca92 (192.168.202.146@tcp) 00000020:01000000:1.0:1787841772.333716:0:6920:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787841772.333729:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841772.333760:0:6920:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff946487c1ced8) 00000020:00000080:1.0:1787841772.333786:0:6920:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787841772.333793:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787841772.333899:0:6920:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787841772.333907:0:6920:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787841772.333915:0:6920:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135d60 00010000:00080000:1.0:1787841772.333965:0:6920:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946487c57000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.146@tcp at head 00010000:00010000:1.0:1787841772.334220:0:6920:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787841772.463700:0:6920:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787841772.463731:0:6920:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787841772.467080:0:6920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841772.467373:0:6920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841772.467433:0:6920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787841772.467523:0:6920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787841772.469614:0:6923:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841772.469623:0:6923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787841772.471764:0:6920:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787841772.471781:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787841772.471825:0:6920:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787841772.471850:0:6920:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e135d67 00000100:00080000:2.0:1787841772.471864:0:6920:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787841772.471873:0:6920:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946487c57000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:2.0:1787841772.471922:0:6920:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464932e70c0 x1874687877458432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787841772.471954:0:6920:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787841772.472063:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877458432:0@lo:8: 00000100:00100000:0.0:1787841772.472158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841772.472244:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458432 00000100:00100000:0.0:1787841772.472251:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458432 00000100:00100000:0.0:1787841772.472283:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841772.472303:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1874687877458432:12345-0@lo:8: 00010000:00080000:0.0:1787841772.472332:0:6691:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:0.0:1787841772.472357:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e135d6e 00002000:00100000:0.0:1787841772.472401:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9464bfa13800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787841772.472406:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787841772.472409:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787841772.472554:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787841772.472702:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787841772.472729:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9464bfa15000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841772.472784:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874687877458432:12345-0@lo:8: Request processed in 492us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.472791:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787841772.472839:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e70c0 x1874687877458432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787841782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841772.472850:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787841772.472859:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787841772.472865:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787841772.472871:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787841772.472873:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946487c57000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787841772.472886:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787841772.472891:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877458432:0@lo:8: 00000004:00080000:0.0:1787841772.472919:0:6923:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787841772.473038:0:6923:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 161447580184ns, next at 0ns, rc = 0 00000020:01000000:2.0:1787841772.473517:0:6920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841772.473525:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841772.473527:0:6920:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787841772.473531:0:6920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841772.473537:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841772.473539:0:6920:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787841772.473542:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787841772.473545:0:6920:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787841772.473579:0:6920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6920:1874687877458560:0@lo:502: 00000100:00100000:2.0:1787841772.473640:0:6920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841772.473674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458560 00000100:00100000:2.0:1787841772.473679:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458560 00000100:00100000:2.0:1787841772.473717:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787841772.473725:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:6920:x1874687877458560:12345-0@lo:502: 00000100:00100000:2.0:1787841772.473931:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:6920:x1874687877458560:12345-0@lo:502: Request processed in 205us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841772.473950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787841772.474102:0:6920:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485df4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841772.474121:0:6920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:6920:1874687877458560:0@lo:502: 00000020:01000000:2.0:1787841772.474154:0:6920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841772.474158:0:6920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841772.474160:0:6920:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787841772.474163:0:6920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787841772.474216:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787841772.474236:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787841772.474247:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841772.474258:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841772.474268:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787841772.474271:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9464871a4ed8 from 1 10000000:01000000:2.0:1787841772.474274:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787841772.478404:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841772.478429:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841772.478447:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841772.478513:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458688:0@lo:101: 00000100:00100000:2.0:1787841772.478596:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841772.478716:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.482216:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458688 00000100:00100000:0.0:1787841772.482238:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458688 00000100:00100000:0.0:1787841772.482442:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787841772.482473:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877458688:12345-0@lo:101: 00010000:00010000:0.0:1787841772.482496:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841772.482519:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135d75 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841772.482575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841772.482587:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841772.482599:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481400, rc 0) 00000100:00100000:0.0:1787841772.482692:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877458688:12345-0@lo:101: Request processed in 240us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.482699:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787841772.482908:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458688:0@lo:101: 00010000:00010000:2.0:1787841772.482930:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841772.482957:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841772.483062:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458816:0@lo:501: 00000100:00100000:2.0:1787841772.483101:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841772.483321:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.497540:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458816 00000100:00100000:0.0:1787841772.497570:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458816 00000100:00100000:0.0:1787841772.497650:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787841772.497662:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877458816:12345-0@lo:501: 00000100:00100000:0.0:1787841772.498013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877458816:12345-0@lo:501: Request processed in 351us (14909us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841772.498022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787841772.498084:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877458816:0@lo:501: 10000000:01000000:0.0:1787841772.498128:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787841772.498140:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841772.498152:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841772.590588:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787841772.713953:0:6924:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787841772.713988:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459072:0@lo:7: 00000100:00100000:3.0:1787841772.714396:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.714482:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841772.714514:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877458944:0@lo:13: 00000100:00100000:3.0:1787841772.714541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841772.714656:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877458944 00000100:00100000:3.0:1787841772.714663:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877458944 00000100:00100000:3.0:1787841772.714717:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841772.714727:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877458944:12345-0@lo:13: 00002000:00000024:3.0:1787841772.714761:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787841772.714798:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877458944:12345-0@lo:13: Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841772.714805:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787841772.714843:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94648c9121c0 x1874687877458944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841772.714861:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877458944:0@lo:13: 00000100:00100000:0.0:1787841772.714983:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459072 00000100:00100000:0.0:1787841772.714992:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459072 00000100:00100000:0.0:1787841772.715025:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841772.715032:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c911e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6924:x1874687877459072:12345-0@lo:7: 00000100:00080000:2.0:1787841772.716224:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787841772.728790:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787841772.728799:0:6694:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787841772.728923:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c911e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6924:x1874687877459072:12345-0@lo:7: Request processed in 13885us (14521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.728945:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787841772.729226:0:6924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94648c912940 x1874687877459072/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787841788 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841772.729244:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459072:0@lo:7: 00000004:00080000:1.0:1787841772.729260:0:6924:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787841772.729318:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459200:0@lo:5: 00000100:00100000:1.0:1787841772.729355:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841772.729405:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648923e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.729901:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459200 00000100:00100000:0.0:1787841772.729908:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459200 00000100:00100000:0.0:1787841772.729966:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841772.729976:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6924:x1874687877459200:12345-0@lo:5: 00002000:00080000:0.0:1787841772.730005:0:6693:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787841772.730009:0:6693:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787841772.730445:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6924:x1874687877459200:12345-0@lo:5: Request processed in 469us (1087us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787841772.730454:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787841772.730534:0:6924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94648cb2c3c0 x1874687877459200/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841788 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841772.730666:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459200:0@lo:5: 00000004:00080000:0.0:1787841772.730680:0:6924:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787841772.730712:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459328:0@lo:700: 00000100:00100000:0.0:1787841772.730741:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841772.730760:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ceb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.730790:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459328 00000100:00100000:0.0:1787841772.730794:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459328 00000100:00100000:0.0:1787841772.730823:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841772.730830:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493292940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6924:x1874687877459328:12345-0@lo:700: 00000100:00100000:0.0:1787841772.730874:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1874687877459456:0@lo:700: 00000100:00100000:0.0:1787841772.730904:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841772.730927:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ceb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841772.730956:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459456 00000100:00100000:0.0:1787841772.730959:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459456 00000100:00100000:0.0:1787841772.730981:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841772.730987:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1874687877459456:12345-0@lo:700: 40000000:02000000:0.0:1787841772.921199:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787841772.933975:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1874687877459456:12345-0@lo:700: Request processed in 202976us (203058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841772.933990:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787841772.934125:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493290000 x1874687877459456/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787841788 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841772.934143:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1874687877459456:0@lo:700: 40000000:02000000:2.0:1787841772.934159:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:3.0:1787841772.978339:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787841773.036395:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787841773.036420:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787841773.109379:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493292940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6924:x1874687877459328:12345-0@lo:700: Request processed in 378533us (378622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841773.109404:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787841773.109528:0:6924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493290f00 x1874687877459328/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787841788 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841773.109554:0:6924:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787841773.109577:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459328:0@lo:700: 00000004:02000040:2.0:1787841773.202109:0:6924:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787841773.206753:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459584:0@lo:5: 00000100:00100000:2.0:1787841773.206825:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841773.207009:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841773.207121:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459584 00000100:00100000:3.0:1787841773.207130:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459584 00000100:00100000:3.0:1787841773.207220:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841773.207231:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6924:x1874687877459584:12345-0@lo:5: 00002000:00080000:3.0:1787841773.216942:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787841773.216970:0:6694:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787841773.223786:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6924:x1874687877459584:12345-0@lo:5: Request processed in 16548us (16950us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787841773.223804:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787841773.223868:0:6924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e5a40 x1874687877459584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841773.223888:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6924:1874687877459584:0@lo:5: 00000004:00080000:2.0:1787841773.223906:0:6924:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787841774.001687:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841775.028681:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841775.297089:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787841776.063632:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841777.073935:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841777.906183:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877459712:0@lo:13: 00000100:00100000:3.0:1787841777.906279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841777.906802:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459712 00000100:00100000:1.0:1787841777.906812:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459712 00000100:00100000:1.0:1787841777.907080:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841777.908135:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877459968:0@lo:400: 00000100:00100000:1.0:1787841777.908315:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c910b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877459712:12345-0@lo:13: 00000100:00080000:2.0:1787841777.908549:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841777.908567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877459840:0@lo:400: 00000100:00100000:2.0:1787841777.908640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841777.908812:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459840 00000100:00100000:2.0:1787841777.908818:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459840 00000100:00100000:3.0:1787841777.910514:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841777.910541:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877460096:0@lo:400: 00000100:00100000:3.0:1787841777.910613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841777.910683:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460096 00000100:00100000:3.0:1787841777.910690:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460096 00000100:00100000:3.0:1787841777.910763:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787841777.910773:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c9130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877460096:12345-0@lo:400: 00000100:00100000:3.0:1787841777.910833:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c9130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877460096:12345-0@lo:400: Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841777.910840:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841777.911111:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787841777.911367:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841777.912299:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c910b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877459712:12345-0@lo:13: Request processed in 5205us (6014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841777.912310:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841777.912390:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877459968 00000100:00100000:1.0:1787841777.912398:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877459968 00000100:00100000:1.0:1787841777.912448:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841777.912477:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877459968:12345-0@lo:400: 00000100:00100000:1.0:1787841777.912525:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877459968:12345-0@lo:400: Request processed in 69us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841777.912530:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787841777.912580:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493293c00 x1874687877459968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841777.912595:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877459968:0@lo:400: 00000100:00080000:1.0:1787841777.912631:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841777.912660:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493290f00 x1874687877460096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841777.912670:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877460096:0@lo:400: 00010000:00080000:1.0:1787841777.912682:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e4000 x1874687877459712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841777.912698:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877459712:0@lo:13: 00000100:00100000:2.0:1787841777.912913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787841777.912928:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877459840:12345-0@lo:400: 00000100:00100000:2.0:1787841777.912996:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877459840:12345-0@lo:400: Request processed in 73us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841777.913620:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787841777.915608:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877459840:0@lo:400: 00010000:00010000:1.0:1787841778.097829:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787841778.559050:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787841779.128444:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841780.146120:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841781.172406:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841782.196587:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841783.025831:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841783.025974:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877460224:0@lo:13: 00000100:00100000:3.0:1787841783.026056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841783.026133:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877460352:0@lo:400: 00000100:00100000:1.0:1787841783.026187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841783.026260:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460352 00000100:00100000:2.0:1787841783.026288:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877460480:0@lo:400: 00000100:00100000:1.0:1787841783.026295:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460352 00000100:00100000:2.0:1787841783.026335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841783.026354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841783.026364:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877460352:12345-0@lo:400: 00000100:00100000:2.0:1787841783.026372:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460480 00000100:00100000:2.0:1787841783.026375:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460480 00000100:00100000:2.0:1787841783.026404:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841783.026410:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877460480:12345-0@lo:400: 00000100:00100000:1.0:1787841783.026412:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877460352:12345-0@lo:400: Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841783.026418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787841783.026445:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877460480:12345-0@lo:400: Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841783.026528:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841783.026553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877460736:0@lo:400: 00000100:00100000:2.0:1787841783.026581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841783.026646:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841783.026653:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877460608:0@lo:400: 00000100:00100000:2.0:1787841783.026675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787841783.026732:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e7480 x1874687877460480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841783.026745:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877460480:0@lo:400: 00000100:00100000:2.0:1787841783.026782:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877460352:0@lo:400: 00000100:00100000:1.0:1787841783.027293:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460736 00000100:00100000:1.0:1787841783.027298:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460736 00000100:00100000:1.0:1787841783.027405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841783.027413:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877460736:12345-0@lo:400: 00000100:00100000:1.0:1787841783.027483:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877460736:12345-0@lo:400: Request processed in 71us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841783.027490:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787841783.027521:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e70c0 x1874687877460736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841783.027529:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787841783.027542:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877460736:0@lo:400: 00000100:00080000:2.0:1787841783.027590:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841783.036959:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460224 00000100:00100000:0.0:1787841783.036981:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460224 00000100:00100000:0.0:1787841783.037054:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841783.037066:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c911680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877460224:12345-0@lo:13: 00002000:00000024:0.0:1787841783.037111:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841783.037228:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c911680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877460224:12345-0@lo:13: Request processed in 164us (11171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841783.037236:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841783.037342:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460608 00000100:00100000:2.0:1787841783.037349:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460608 00000100:00100000:2.0:1787841783.037395:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787841783.037403:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877460608:12345-0@lo:400: 00000100:00100000:2.0:1787841783.037448:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877460608:12345-0@lo:400: Request processed in 46us (10771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841783.037471:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787841783.037488:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841783.037635:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e4000 x1874687877460608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841783.037653:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877460608:0@lo:400: 00010000:00080000:1.0:1787841783.037692:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464932e5e00 x1874687877460224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841783.037707:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877460224:0@lo:13: 00010000:00010000:1.0:1787841783.219245:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841784.244254:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841785.282819:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841786.296180:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841787.313716:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841788.146584:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841788.146616:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877460864:0@lo:13: 00000100:00100000:3.0:1787841788.146691:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841788.146762:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460864 00000100:00100000:3.0:1787841788.146770:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460864 00000100:00100000:3.0:1787841788.146841:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841788.146850:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877460864:12345-0@lo:13: 00002000:00000024:3.0:1787841788.146887:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841788.146934:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877460864:12345-0@lo:13: Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.146942:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787841788.146964:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787841788.146994:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94648c910f00 x1874687877460864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841788.147011:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877460864:0@lo:13: 00000100:00100000:1.0:1787841788.148202:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877460992:0@lo:400: 00000100:00100000:1.0:1787841788.148256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841788.148343:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877460992 00000100:00100000:2.0:1787841788.148350:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877460992 00000100:00100000:0.0:1787841788.148440:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877461120:0@lo:400: 00000100:00100000:0.0:1787841788.148499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.148524:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841788.148530:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877461248:0@lo:400: 00000100:00100000:0.0:1787841788.148570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.148604:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461120 00000100:00100000:0.0:1787841788.148608:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461120 00000100:00100000:2.0:1787841788.148618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787841788.148628:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:3309:x1874687877460992:12345-0@lo:400: 00000100:00100000:0.0:1787841788.148636:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461248 00000100:00100000:0.0:1787841788.148638:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461248 00000100:00100000:0.0:1787841788.148660:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787841788.148666:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877461120:12345-0@lo:400: 00000100:00100000:0.0:1787841788.148719:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877461120:12345-0@lo:400: Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.148725:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787841788.148762:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787841788.148769:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877461248:12345-0@lo:400: 00000100:00100000:0.0:1787841788.148808:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877461248:12345-0@lo:400: Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.148814:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787841788.148829:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787841788.148857:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493293c00 x1874687877461248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841788.148871:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877461248:0@lo:400: 00010000:00080000:0.0:1787841788.148880:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946493290f00 x1874687877461120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841788.148888:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877461120:0@lo:400: 00000100:00100000:2.0:1787841788.150170:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:3309:x1874687877460992:12345-0@lo:400: Request processed in 1536us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.150187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787841788.153322:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877460992:0@lo:400: 00010000:00010000:3.0:1787841788.337679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787841788.641876:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787841788.641881:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787841788.642030:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9464c1af7000 00000020:01000004:2.0:1787841788.642051:0:7626:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787841788.642065:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787841788.642080:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff946484e61a48) 00000020:00000080:2.0:1787841788.642099:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787841788.685580:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787841788.685925:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787841788.713367:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787841788.719618:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787841788.719863:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787841788.719921:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787841788.719949:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787841788.720705:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787841788.720721:0:7626:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787841788.720839:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d0ed3605e135d8a 00000020:01000004:1.0:1787841788.720851:0:7626:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787841788.720880:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.146@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787841788.720884:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787841788.720892:0:7626:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787841788.720913:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787841788.720917:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787841788.755137:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787841788.755192:0:7626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.146@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787841788.755196:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787841788.755198:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841788.755200:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841788.755200:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841788.755201:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841788.755203:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841788.755204:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841788.755206:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787841788.755208:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787841788.755209:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841788.755211:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841788.755215:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787841788.755217:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787841788.755218:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841788.755219:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841788.755220:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841788.755221:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841788.755222:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841788.755223:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841788.755225:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787841788.755226:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787841788.755227:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841788.755228:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841788.755267:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787841788.755287:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877461376:0@lo:253: 00000100:00100000:0.0:1787841788.755376:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.755431:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.756015:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461376 00000100:00100000:3.0:1787841788.756024:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461376 00000100:00100000:3.0:1787841788.756091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841788.756102:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:7626:x1874687877461376:12345-0@lo:253: 20000000:01000000:3.0:1787841788.756149:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787841788.756153:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787841788.756159:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787841788.756163:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787841788.757580:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841788.759227:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787841788.759614:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787841788.759836:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787841788.759846:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787841788.759875:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787841788.759926:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787841788.761006:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787841788.761037:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.146@tcp 20000000:01000000:3.0:1787841788.761039:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.146@tcp (null) (null) (null) 00000040:00080000:3.0:1787841788.761083:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787841788.761093:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787841788.761144:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787841788.761153:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.146@tcp (null) (null) 00000040:00080000:3.0:1787841788.761190:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787841788.761199:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787841788.761227:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787841788.761941:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787841788.763880:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787841788.763916:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.146@tcp 20000000:01000000:3.0:1787841788.763919:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.146@tcp (null) (null) (null) 00000040:00080000:3.0:1787841788.763963:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787841788.763972:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787841788.764023:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787841788.764032:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.146@tcp (null) (null) 00000040:00080000:3.0:1787841788.764064:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787841788.764073:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787841788.764132:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787841788.764172:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787841788.764193:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787841788.764196:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787841788.764205:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787841788.764207:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787841788.764209:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787841788.764224:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787841788.764228:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787841788.764926:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787841788.764930:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787841788.766080:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787841788.767091:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787841788.767147:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787841788.767243:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787841788.767329:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787841788.767333:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787841788.768143:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787841788.768212:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787841788.768558:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787841788.769006:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787841788.769049:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787841788.769114:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787841788.769128:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787841788.769130:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787841788.770157:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787841788.770221:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787841788.770345:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787841788.771036:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787841788.771081:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787841788.771115:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787841788.771128:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787841788.771130:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787841788.772798:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787841788.772907:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787841788.772940:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787841788.773837:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787841788.773889:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787841788.773941:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1787841788.773961:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787841788.773985:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774007:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774030:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774037:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774044:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774052:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774060:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774111:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774131:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 16 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.774148:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461504:0@lo:104: 00000100:00100000:3.0:1787841788.774231:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841788.774426:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774436:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 16 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.774444:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461632:0@lo:104: 00010000:00010000:3.0:1787841788.774636:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774811:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 16 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.774823:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461760:0@lo:104: 00010000:00010000:3.0:1787841788.774852:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774860:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 16 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.774866:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461888:0@lo:104: 00010000:00010000:3.0:1787841788.774913:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.774920:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 16 pid: 5844 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.774929:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877462016:0@lo:104: 00000100:00100000:3.0:1787841788.774946:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ceb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841788.775147:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787841788.775172:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.775231:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.775369:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.775503:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461504 00000100:00100000:0.0:1787841788.775522:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461504 00000100:00100000:0.0:1787841788.775570:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461632 00000100:00100000:0.0:1787841788.775573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461632 00000100:00100000:0.0:1787841788.775585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461760 00000100:00100000:0.0:1787841788.775587:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461760 00000100:00100000:0.0:1787841788.775600:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841788.775609:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648706b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+5:5841:x1874687877461504:12345-0@lo:104: 00010000:00010000:0.0:1787841788.775624:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.775934:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841788.775943:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648706b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+5:5841:x1874687877461504:12345-0@lo:104: Request processed in 334us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.775951:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841788.776000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841788.776007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+4:5841:x1874687877461632:12345-0@lo:104: 00010000:00010000:0.0:1787841788.776015:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.776051:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787841788.776056:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+4:5841:x1874687877461632:12345-0@lo:104: Request processed in 50us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.776061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841788.776073:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787841788.776079:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5841:x1874687877461760:12345-0@lo:104: 00010000:00010000:0.0:1787841788.776086:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.776112:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787841788.776123:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:5841:x1874687877461760:12345-0@lo:104: Request processed in 44us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.776129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787841788.776148:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787841788.776154:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.776162:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841788.776166:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.776176:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841788.776183:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841788.776189:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787841788.776224:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.776231:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841788.776249:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.778581:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841788.778968:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841788.778981:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.778995:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841788.779000:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.779012:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841788.779019:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841788.779026:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841788.779074:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.779081:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841788.779093:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.779108:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.779123:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.779125:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.779127:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841788.779503:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464c2044600/0x1d0ed3605e135d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.779519:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841788.779521:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841788.779523:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841788.779567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877462144:0@lo:103: 00000100:00100000:0.0:1787841788.779644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.780608:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841788.780619:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877462272:0@lo:103: 00000100:00100000:0.0:1787841788.780657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.780715:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462144 00000100:00100000:0.0:1787841788.780723:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462144 00000100:00100000:3.0:1787841788.780891:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461504:0@lo:104: 00000100:00100000:3.0:1787841788.780904:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461632:0@lo:104: 00000100:00100000:3.0:1787841788.780912:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461760:0@lo:104: 00010000:00010000:2.0:1787841788.781013:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.781023:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.781033:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841788.781037:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.781048:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841788.781056:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841788.781062:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841788.781106:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.781113:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841788.781132:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.781139:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481499600/0x1d0ed3605e135d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.781167:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.781169:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.781171:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.781176:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.781177:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841788.781611:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.781626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877461888 00000100:00100000:1.0:1787841788.781639:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877461888 00000100:00100000:1.0:1787841788.781681:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462016 00000100:00100000:1.0:1787841788.781684:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462016 00000100:00100000:1.0:1787841788.781699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841788.781707:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:5841:x1874687877461888:12345-0@lo:104: 00010000:00010000:1.0:1787841788.781721:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.781853:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 17 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.781929:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462272 00000100:00100000:0.0:1787841788.781934:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462272 00010000:00010000:0.0:1787841788.781948:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 18 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.782025:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841788.782032:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:5841:x1874687877461888:12345-0@lo:104: Request processed in 326us (6663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841788.782039:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841788.782060:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841788.782067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:5841:x1874687877462016:12345-0@lo:104: 00010000:00010000:1.0:1787841788.782076:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.782107:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787841788.782112:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:5841:x1874687877462016:12345-0@lo:104: Request processed in 47us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841788.782117:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841788.782165:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877462400:0@lo:103: 00000100:00100000:1.0:1787841788.782198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787841788.784319:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841788.784337:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784350:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dc200 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841788.784354:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784364:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841788.784371:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841788.784377:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841788.784426:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784432:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841788.784446:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784453:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dc200/0x1d0ed3605e135d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d0c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784518:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841788.784522:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784529:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dc600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841788.784531:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784538:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841788.784544:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841788.784549:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841788.784564:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784570:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841788.784595:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784602:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dc600/0x1d0ed3605e135cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135ce2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.784618:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.784619:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.784621:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841788.787841:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877461888:0@lo:104: 00000100:00100000:2.0:1787841788.787889:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874687877462016:0@lo:104: 00010000:00010000:2.0:1787841788.787950:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841788.788395:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841788.788683:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462400 00000100:00100000:3.0:1787841788.788693:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462400 00010000:00010000:3.0:1787841788.788863:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 19 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.788903:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841788.788913:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877462144:12345-0@lo:103: 00010000:00010000:3.0:1787841788.788950:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841788.788957:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 19 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.788971:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 19 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.788994:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481400/0x1d0ed3605e135d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135d75 expref: 19 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789013:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841788.789073:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+18:3308:x1874687877462144:12345-0@lo:103: Request processed in 161us (9428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.789081:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841788.789102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841788.789109:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+17:3308:x1874687877462272:12345-0@lo:103: 00010000:00010000:3.0:1787841788.789118:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841788.789122:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 17 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789132:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 17 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789142:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135d4b expref: 17 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789164:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841788.789189:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877462272:12345-0@lo:103: Request processed in 80us (8531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.789196:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841788.789210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841788.789216:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+15:3306:x1874687877462400:12345-0@lo:103: 00010000:00010000:3.0:1787841788.789223:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841788.789227:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 15 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789236:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 15 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789247:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481498200/0x1d0ed3605e135d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135d2f expref: 15 pid: 5842 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789258:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841788.789281:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+14:3306:x1874687877462400:12345-0@lo:103: Request processed in 65us (7082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.789288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841788.789625:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877462528:0@lo:103: 00000100:00100000:1.0:1787841788.789669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.789722:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877462400:0@lo:103: 00000100:00100000:3.0:1787841788.789823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462528 00000100:00100000:3.0:1787841788.789829:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462528 00010000:00010000:3.0:1787841788.789848:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 14 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.789866:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841788.789873:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+14:3306:x1874687877462528:12345-0@lo:103: 00010000:00010000:3.0:1787841788.789881:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841788.789894:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 14 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789903:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 14 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789915:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481499c00/0x1d0ed3605e135d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135d05 expref: 14 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.789924:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841788.789948:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+13:3306:x1874687877462528:12345-0@lo:103: Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.789953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841788.790010:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877462528:0@lo:103: 00010000:00010000:1.0:1787841788.790108:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841788.790127:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877462656:0@lo:103: 00000100:00100000:1.0:1787841788.790154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.790181:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877462272:0@lo:103: 00000100:00100000:1.0:1787841788.790191:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877462144:0@lo:103: 00000100:00100000:3.0:1787841788.790272:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462656 00000100:00100000:3.0:1787841788.790276:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462656 00010000:00010000:3.0:1787841788.790292:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 13 pid: 5844 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841788.790317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841788.790325:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+13:3308:x1874687877462656:12345-0@lo:103: 00010000:00010000:3.0:1787841788.790332:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841788.790336:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 13 pid: 5844 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790345:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 13 pid: 5844 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790637:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135cdb expref: 13 pid: 5844 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790650:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790667:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790682:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790689:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790697:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790705:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790711:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dc000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841788.790716:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790725:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790823:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.790835:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841788.790876:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+12:3308:x1874687877462656:12345-0@lo:103: Request processed in 552us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.790882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841788.790910:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877462656:0@lo:103: 00010000:00010000:2.0:1787841788.790965:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.790974:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.790981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135d91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787841788.790996:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787841788.859559:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877461376:0@lo:253: 10000000:01000000:0.0:1787841788.859580:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787841788.859584:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787841788.859586:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841788.859588:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841788.859589:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787841788.859590:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841788.859592:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841788.859593:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841788.859595:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787841788.859596:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841788.859598:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787841788.859618:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464c1af7000 from lustre-OST0001 10000000:01000000:0.0:1787841788.859645:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787841788.859649:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787841788.859657:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9464871a4ed8 local copy 10000000:01000000:0.0:1787841788.859661:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787841788.859699:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.859737:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.859748:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.859767:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877462784:0@lo:101: 00000100:00100000:0.0:1787841788.859818:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.859855:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.859924:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462784 00000100:00100000:3.0:1787841788.859931:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462784 00000100:00100000:3.0:1787841788.859975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787841788.859983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877462784:12345-0@lo:101: 00010000:00010000:3.0:1787841788.860003:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841788.860017:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135d98 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.860041:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135d98 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.860052:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d98 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.860062:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dd800, rc 0) 00000100:00100000:3.0:1787841788.860104:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877462784:12345-0@lo:101: Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.860111:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787841788.860351:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877461376:12345-0@lo:253: Request processed in 103297us (104020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.860359:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841788.860607:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877462784:0@lo:101: 00010000:00010000:0.0:1787841788.860623:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.860633:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.860779:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877462912:0@lo:501: 00000100:00100000:0.0:1787841788.860822:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.860849:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.861022:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877462912 00000100:00100000:3.0:1787841788.861028:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877462912 00000100:00100000:3.0:1787841788.861063:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787841788.861071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877462912:12345-0@lo:501: 00000100:00100000:3.0:1787841788.861530:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877462912:12345-0@lo:501: Request processed in 459us (706us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841788.861538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787841788.861813:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877462912:0@lo:501: 10000000:01000000:0.0:1787841788.861829:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787841788.861862:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787841788.861869:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.861879:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.861895:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.861918:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787841788.861942:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9464c1af7000 10000000:01000000:0.0:1787841788.861947:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787841788.861953:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787841788.861956:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787841788.861961:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787841788.861964:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787841788.861986:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.862074:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841788.862081:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.862172:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.862185:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.862201:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463040:0@lo:101: 00000100:00100000:0.0:1787841788.862235:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.862273:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.862856:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463040 00000100:00100000:3.0:1787841788.862863:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463040 00000100:00100000:3.0:1787841788.862903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787841788.862912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463040:12345-0@lo:101: 00010000:00010000:3.0:1787841788.862935:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841788.862947:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135da6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.862972:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.862983:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.863170:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dd600, rc 0) 00000100:00100000:3.0:1787841788.863226:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877463040:12345-0@lo:101: Request processed in 313us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.863233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787841788.863321:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463040:0@lo:101: 00010000:00010000:2.0:1787841788.863388:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841788.863393:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.863412:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841788.863421:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841788.863437:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841788.863484:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.863490:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841788.863516:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.863524:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135d98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1d0ed3605e135d9f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.863538:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.863540:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841788.863542:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841788.863646:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841788.863659:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877463168:0@lo:103: 00000100:00100000:3.0:1787841788.863693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841788.863982:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463168 00000100:00100000:2.0:1787841788.863988:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463168 00000100:00100000:2.0:1787841788.864042:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841788.864049:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+13:3308:x1874687877463168:12345-0@lo:103: 00010000:00010000:2.0:1787841788.864061:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841788.864075:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135d98 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841788.864241:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841788.864290:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+12:3308:x1874687877463168:12345-0@lo:103: Request processed in 241us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.864297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841788.864440:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877463168:0@lo:103: 00010000:00010000:0.0:1787841788.864801:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.864813:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841788.865055:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463296:0@lo:501: 00000100:00100000:1.0:1787841788.865221:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.865258:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841788.865314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463296 00000100:00100000:2.0:1787841788.865320:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463296 00000100:00100000:2.0:1787841788.865367:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787841788.865381:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463296:12345-0@lo:501: 00000100:00100000:2.0:1787841788.865666:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463296:12345-0@lo:501: Request processed in 286us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.865674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841788.866128:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463296:0@lo:501: 00000100:00100000:1.0:1787841788.866169:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463424:0@lo:503: 00000100:00100000:1.0:1787841788.866213:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.866244:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.866358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463424 00000100:00100000:3.0:1787841788.866364:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463424 00000100:00100000:3.0:1787841788.866409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787841788.866417:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463424:12345-0@lo:503: 00000100:00100000:3.0:1787841788.866604:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463424:12345-0@lo:503: Request processed in 187us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.866611:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841788.866894:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463424:0@lo:503: 00000040:00080000:1.0:1787841788.867284:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787841788.867365:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463552:0@lo:502: 00000100:00100000:1.0:1787841788.867498:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.867572:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841788.867921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463552 00000100:00100000:0.0:1787841788.867927:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463552 00000100:00100000:1.0:1787841788.868046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841788.868056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463552:12345-0@lo:502: 00000100:00100000:1.0:1787841788.868274:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463552:12345-0@lo:502: Request processed in 218us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841788.868282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787841788.868896:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463552:0@lo:502: 00000040:00080000:0.0:1787841788.869237:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787841788.869300:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787841788.869333:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787841788.869394:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787841788.869445:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787841788.869532:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787841788.869573:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463680:0@lo:502: 00000100:00100000:0.0:1787841788.869637:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.869671:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841788.870220:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463680 00000100:00100000:1.0:1787841788.870229:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463680 00000100:00100000:1.0:1787841788.870298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841788.870308:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463680:12345-0@lo:502: 00000100:00100000:1.0:1787841788.870671:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463680:12345-0@lo:502: Request processed in 364us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841788.870678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787841788.870919:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463680:0@lo:502: 00000040:00080000:0.0:1787841788.871050:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787841788.871063:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787841788.871956:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787841788.871966:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787841788.871972:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841788.871983:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787841788.871990:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787841788.872015:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9464bfa28000) 00000020:00000080:3.0:1787841788.872037:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787841788.872043:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787841788.872113:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464c1af7000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787841788.872121:0:7637:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787841788.872128:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d0ed3605e135dbb 00010000:00010000:3.0:1787841788.877917:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787841788.880004:0:7637:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787841788.881970:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787841788.882287:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787841788.889313:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787841788.890061:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787841788.893631:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787841788.893649:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841788.893658:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841788.893660:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787841788.893664:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841788.893668:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841788.893670:0:7637:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841788.893673:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841788.893675:0:7637:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787841788.893740:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841788.893744:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841788.893745:0:7637:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787841788.893749:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787841788.893994:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787841788.894026:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787841788.894056:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.894071:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841788.894080:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464c1af7000 from 1 10000000:01000000:0.0:1787841788.894092:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841788.894134:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.894155:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.894169:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.894195:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463808:0@lo:101: 00000100:00100000:0.0:1787841788.894271:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.894320:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841788.895352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463808 00000100:00100000:0.0:1787841788.895365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463808 00000100:00100000:0.0:1787841788.895440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787841788.895453:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+12:7626:x1874687877463808:12345-0@lo:101: 00010000:00010000:0.0:1787841788.895488:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841788.895506:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135dc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.895538:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.895553:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.895563:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841788.895626:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877463808:12345-0@lo:101: Request processed in 176us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.895634:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787841788.895695:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463808:0@lo:101: 00010000:00010000:0.0:1787841788.895720:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.895731:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.895861:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463936:0@lo:501: 00000100:00100000:0.0:1787841788.895897:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.895915:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841788.898817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877463936 00000100:00100000:2.0:1787841788.898835:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877463936 00000100:00100000:2.0:1787841788.898898:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787841788.898908:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877463936:12345-0@lo:501: 00000100:00100000:2.0:1787841788.901808:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877463936:12345-0@lo:501: Request processed in 2880us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.901823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787841788.902560:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877463936:0@lo:501: 00000100:00100000:0.0:1787841788.902630:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464064:0@lo:503: 00000100:00100000:0.0:1787841788.902698:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.902739:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841788.903280:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464064 00000100:00100000:2.0:1787841788.903289:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464064 00000100:00100000:2.0:1787841788.903387:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787841788.903398:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464064:12345-0@lo:503: 00000100:00100000:2.0:1787841788.903841:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464064:12345-0@lo:503: Request processed in 443us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.903849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841788.906115:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464064:0@lo:503: 00000040:00080000:1.0:1787841788.906595:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787841788.906696:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464192:0@lo:502: 00000100:00100000:1.0:1787841788.906802:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.909955:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841788.910050:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464192 00000100:00100000:0.0:1787841788.910061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464192 00000100:00100000:0.0:1787841788.910179:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787841788.910188:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464192:12345-0@lo:502: 00000100:00100000:0.0:1787841788.911291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464192:12345-0@lo:502: Request processed in 1099us (4495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.911303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787841788.911391:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464192:0@lo:502: 00000040:00080000:1.0:1787841788.911891:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787841788.911948:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787841788.911985:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464320:0@lo:502: 00000100:00100000:1.0:1787841788.912039:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.912178:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841788.912212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464320 00000100:00100000:2.0:1787841788.912218:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464320 00000100:00100000:2.0:1787841788.912303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787841788.912314:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464320:12345-0@lo:502: 00000100:00100000:2.0:1787841788.912754:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464320:12345-0@lo:502: Request processed in 440us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.912763:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787841788.912850:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464320:0@lo:502: 00000040:00080000:1.0:1787841788.912976:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787841788.912991:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787841788.913597:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841788.913610:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841788.913612:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787841788.913619:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464c1af7000 00000020:00000080:1.0:1787841788.913621:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787841788.913644:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841788.913647:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841788.913649:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787841788.913662:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787841788.913781:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787841788.913814:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841788.913840:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.913852:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841788.913906:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787841788.913909:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9464c1af7000 10000000:01000000:0.0:1787841788.913913:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9464c1af7000 10000000:01000000:0.0:1787841788.913918:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787841788.913924:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9464c1af7000 from 1 10000000:01000000:0.0:1787841788.913926:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787841788.913961:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.913968:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.913980:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.914001:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464448:0@lo:101: 00000100:00100000:0.0:1787841788.914048:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.914676:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.914836:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464448 00000100:00100000:3.0:1787841788.914846:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464448 00000100:00100000:3.0:1787841788.914895:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787841788.914906:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877464448:12345-0@lo:101: 00010000:00010000:3.0:1787841788.914922:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841788.914945:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135dd0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.914970:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.914982:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841788.914992:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dde00, rc 0) 00000100:00100000:3.0:1787841788.915040:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464448:12345-0@lo:101: Request processed in 136us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.915047:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787841788.915198:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464448:0@lo:101: 00010000:00010000:0.0:1787841788.915213:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.915223:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.915323:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464576:0@lo:501: 00000100:00100000:0.0:1787841788.915367:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.915396:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.915554:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464576 00000100:00100000:3.0:1787841788.915559:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464576 00000100:00100000:3.0:1787841788.915579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787841788.915584:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464576:12345-0@lo:501: 00000100:00100000:3.0:1787841788.915820:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464576:12345-0@lo:501: Request processed in 234us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.915826:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787841788.915864:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464576:0@lo:501: 00000100:00100000:3.0:1787841788.915892:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464704:0@lo:503: 00000100:00100000:3.0:1787841788.915928:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841788.915949:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff946382f51300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.915961:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464704 00000100:00100000:3.0:1787841788.915964:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464704 00000100:00100000:3.0:1787841788.915980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787841788.915985:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464704:12345-0@lo:503: 00000100:00100000:3.0:1787841788.916427:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464704:12345-0@lo:503: Request processed in 440us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.916435:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787841788.916750:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464704:0@lo:503: 00000040:00080000:0.0:1787841788.917029:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787841788.917120:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464832:0@lo:502: 00000100:00100000:0.0:1787841788.917159:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.917195:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841788.917307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464832 00000100:00100000:3.0:1787841788.917313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464832 00000100:00100000:3.0:1787841788.917352:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787841788.917360:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464832:12345-0@lo:502: 00000100:00100000:3.0:1787841788.917693:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464832:12345-0@lo:502: Request processed in 334us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.917700:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787841788.917780:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464832:0@lo:502: 00000040:00080000:0.0:1787841788.918064:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787841788.918189:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787841788.918226:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787841788.918287:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787841788.918329:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787841788.918381:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787841788.918739:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787841788.918802:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787841788.918856:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787841788.918893:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787841788.918921:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787841788.918962:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787841788.918992:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787841788.919021:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787841788.919060:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787841788.919226:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787841788.919263:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787841788.919320:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787841788.919355:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787841788.919381:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787841788.921278:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787841788.921371:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787841788.921591:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787841788.921678:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787841788.921727:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787841788.921760:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787841788.921822:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787841788.921857:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787841788.921885:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787841788.921923:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787841788.921952:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787841788.921979:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787841788.922006:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787841788.922049:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787841788.922236:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787841788.922294:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787841788.922330:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787841788.922387:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464960:0@lo:502: 00000100:00100000:0.0:1787841788.922738:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.922777:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841788.922871:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877464960 00000100:00100000:2.0:1787841788.922878:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877464960 00000100:00100000:2.0:1787841788.922934:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787841788.922943:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464960:12345-0@lo:502: 00000100:00100000:2.0:1787841788.923451:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877464960:12345-0@lo:502: Request processed in 506us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.923581:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877464960:0@lo:502: 00000040:00080000:0.0:1787841788.923673:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787841788.923685:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000100:00100000:2.0:1787841788.924239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000020:01000004:2.0:1787841788.925205:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787841788.925228:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9463826dced8) 00000020:00000080:2.0:1787841788.925252:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787841788.925329:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464c1af7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787841788.925333:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9464c1af7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787841788.925335:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9464c1af7000 3 00010000:00080000:2.0:1787841788.925373:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946381fa4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.146@tcp at head 00010000:00010000:3.0:1787841788.927906:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787841788.928219:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787841788.928257:0:7642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787841788.928271:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1d0ed3605e135de5 00000100:00080000:3.0:1787841788.928284:0:7642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841788.928291:0:7642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946381fa4000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:3.0:1787841788.928334:0:7642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464b980e1c0 x1874687877465088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841788.928362:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787841788.928594:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874687877465088:0@lo:38: 00000100:00100000:0.0:1787841788.928672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.928728:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465088 00000100:00100000:0.0:1787841788.928735:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465088 00000100:00100000:0.0:1787841788.928772:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841788.928779:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874687877465088:12345-0@lo:38: 00010000:00080000:0.0:1787841788.928815:0:5849:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1787841788.928843:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1d0ed3605e135dec 00000004:00100000:0.0:1787841788.928860:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787841788.928891:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9463825dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841788.928949:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874687877465088:12345-0@lo:38: Request processed in 170us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841788.928957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787841788.928989:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464b980e1c0 x1874687877465088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841788.928999:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787841788.929008:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787841788.929014:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787841788.929019:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787841788.929022:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946381fa4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787841788.929029:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874687877465088:0@lo:38: 00000040:00080000:3.0:1787841788.929315:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787841788.929590:0:7643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e9680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1874687877465216:0@lo:901: 00000100:00100000:0.0:1787841788.929628:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.929693:0:7643:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f840 going to sleep for 11 seconds 00000020:01000000:0.0:1787841788.931539:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787841788.931584:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787841788.931606:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.931620:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787841788.931676:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787841788.931678:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841788.931679:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841788.931680:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841788.931681:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841788.931683:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841788.931684:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841788.931690:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787841788.931691:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787841788.931693:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841788.931694:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787841788.931698:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787841788.931701:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787841788.931702:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841788.931703:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841788.931704:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841788.931704:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841788.931705:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841788.931706:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841788.931707:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787841788.931707:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787841788.931708:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841788.931709:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787841788.931736:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787841788.931754:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877465344:0@lo:253: 00000100:00100000:0.0:1787841788.931824:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.931865:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841788.932758:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465344 00000100:00100000:1.0:1787841788.932768:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465344 00000100:00100000:1.0:1787841788.932832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787841788.932842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:7626:x1874687877465344:12345-0@lo:253: 20000000:01000000:1.0:1787841788.932873:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787841788.932889:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787841788.936419:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465216 00000100:00100000:3.0:1787841788.936435:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465216 00000100:00100000:3.0:1787841788.936545:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841788.936555:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1874687877465216:12345-0@lo:901: 00000100:00100000:3.0:1787841788.937048:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1874687877465216:12345-0@lo:901: Request processed in 493us (7417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841788.937056:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787841788.937192:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787841788.937618:0:7643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464b98e9680 x1874687877465216/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787841804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841788.937635:0:7643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e9680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1874687877465216:0@lo:901: 20000000:01000000:2.0:1787841788.971397:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787841788.971544:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787841788.972364:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787841788.972373:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787841788.972490:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.972515:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.972525:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.972580:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.972596:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 14 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.972630:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874687877465472:0@lo:104: 00000100:00100000:0.0:1787841788.972710:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841788.972751:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841788.972848:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465472 00000100:00100000:1.0:1787841788.972857:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465472 00000100:00100000:1.0:1787841788.972920:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841788.972930:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:5865:x1874687877465472:12345-0@lo:104: 00010000:00010000:1.0:1787841788.972946:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973013:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841788.973019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:5865:x1874687877465472:12345-0@lo:104: Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841788.973026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787841788.973050:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841788.973056:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973064:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dc800 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841788.973068:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973077:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841788.973095:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841788.973108:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841788.973301:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973308:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841788.973337:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973344:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dc800/0x1d0ed3605e135d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135d44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973364:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841788.973365:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841788.973367:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841788.973375:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841788.973387:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877465600:0@lo:103: 00000100:00100000:1.0:1787841788.973583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841788.973623:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465600 00000100:00100000:1.0:1787841788.973627:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465600 00010000:00010000:1.0:1787841788.973649:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 15 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841788.973673:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841788.973681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648709f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+15:3307:x1874687877465600:12345-0@lo:103: 00010000:00010000:1.0:1787841788.973693:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841788.973698:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 15 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973709:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 15 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973736:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973745:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787841788.973760:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004349849s 00010000:00010000:1.0:1787841788.973765:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973773:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973780:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973787:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973804:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787841788.973809:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973817:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973827:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841788.973839:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841788.973871:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648709f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+15:3307:x1874687877465600:12345-0@lo:103: Request processed in 191us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841788.973884:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841788.973956:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877465600:0@lo:103: 00010000:00010000:0.0:1787841788.974221:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481499a00/0x1d0ed3605e135d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135d3d expref: 14 pid: 5841 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841788.974235:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874687877465472:0@lo:104: 00010000:00010000:0.0:1787841788.974250:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.974260:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.974267:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841788.974273:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481e00/0x1d0ed3605e135df3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841788.983377:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:7626:x1874687877465344:12345-0@lo:253: Request processed in 50523us (51540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841788.983395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787841788.983670:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:907da169-f099-4269-9458-b15bc87a550d:7626:1874687877465344:0@lo:253: 10000000:01000000:0.0:1787841788.983688:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787841788.983691:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787841788.983693:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841788.983694:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841788.983695:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841788.983697:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841788.983698:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841788.983700:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841788.983701:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787841788.983703:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787841788.983723:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841788.983725:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787841788.983742:0:7626:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787841788.988403:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841788.988691:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787841788.988917:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841788.989243:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787841788.989907:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841788.990364:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787841788.994198:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787841789.254970:0:7626:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787841789.254979:0:7626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787841789.255016:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787841789.255084:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.146@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787841789.255100:0:7626:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787841789.255200:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787841789.366221:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841790.385649:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841791.419702:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841792.433812:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841793.266321:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841793.266347:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877465728:0@lo:13: 00000100:00100000:2.0:1787841793.266443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841793.266792:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465728 00000100:00100000:3.0:1787841793.266803:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465728 00000100:00100000:3.0:1787841793.267164:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841793.267176:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877465728:12345-0@lo:13: 00002000:00000024:3.0:1787841793.267218:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841793.267272:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877465728:12345-0@lo:13: Request processed in 98us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841793.267279:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787841793.267447:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787841793.267501:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980da40 x1874687877465728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841793.267523:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877465728:0@lo:13: 00010000:00010000:2.0:1787841793.459957:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841794.297129:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877465984:0@lo:400: 00000100:00100000:1.0:1787841794.297204:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841794.297270:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787841794.297276:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877465856:0@lo:400: 00000100:00100000:1.0:1787841794.297307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841794.297332:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877466368:0@lo:400: 00000100:00100000:1.0:1787841794.297371:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841794.297400:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877466112:0@lo:400: 00000100:00100000:1.0:1787841794.297442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841794.297497:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841794.297509:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877466240:0@lo:400: 00000100:00100000:1.0:1787841794.297536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841794.297581:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465984 00000100:00100000:1.0:1787841794.297588:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465984 00000100:00100000:1.0:1787841794.297622:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466368 00000100:00100000:1.0:1787841794.297625:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466368 00000100:00100000:1.0:1787841794.297648:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466112 00000100:00100000:1.0:1787841794.297652:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466112 00000100:00100000:1.0:1787841794.297668:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841794.297675:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877465984:12345-0@lo:400: 00000100:00100000:1.0:1787841794.297727:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877465984:12345-0@lo:400: Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841794.297736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841794.297763:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841794.297769:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877466368:12345-0@lo:400: 00000100:00100000:1.0:1787841794.297794:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877466368:12345-0@lo:400: Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841794.297800:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841794.297810:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841794.297815:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877466112:12345-0@lo:400: 00000100:00100000:1.0:1787841794.297840:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877466112:12345-0@lo:400: Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841794.297845:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841794.297861:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877465856 00000100:00100000:1.0:1787841794.297864:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877465856 00000100:00100000:1.0:1787841794.297886:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787841794.297892:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:3309:x1874687877465856:12345-0@lo:400: 00000100:00100000:1.0:1787841794.297920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:3309:x1874687877465856:12345-0@lo:400: Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841794.297932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787841794.297965:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466240 00000100:00100000:1.0:1787841794.297969:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466240 00000100:00100000:1.0:1787841794.297996:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841794.298003:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877466240:12345-0@lo:400: 00000100:00100000:1.0:1787841794.298034:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877466240:12345-0@lo:400: Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841794.298040:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787841794.298056:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841794.298094:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2ed00 x1874687877466240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841794.298108:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877466240:0@lo:400: 00010000:00080000:1.0:1787841794.298120:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2c000 x1874687877466112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841794.298129:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877466112:0@lo:400: 00000100:00100000:1.0:1787841794.298158:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877465856:0@lo:400: 00010000:00080000:1.0:1787841794.298167:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2e940 x1874687877466368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841794.298176:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877466368:0@lo:400: 00010000:00080000:1.0:1787841794.298186:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2e1c0 x1874687877465984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841794.298193:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877465984:0@lo:400: 00010000:00010000:3.0:1787841794.481621:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841795.505632:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841796.537028:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787841796.539583:0:7985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1787841797.362713:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787841797.362735:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946486706000 from 30 10000000:01000000:3.0:1787841797.362742:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787841797.362793:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.362806:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.362821:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841797.362855:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877466496:0@lo:101: 00000100:00100000:3.0:1787841797.362937:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.362992:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841797.363163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466496 00000100:00100000:0.0:1787841797.363172:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466496 00000100:00100000:0.0:1787841797.363228:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787841797.363238:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:5847:x1874687877466496:12345-0@lo:101: 00010000:00010000:0.0:1787841797.363253:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841797.363267:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135dfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.363292:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.363305:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.363317:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480c00, rc 0) 00000100:00100000:0.0:1787841797.363368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877466496:12345-0@lo:101: Request processed in 132us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.363375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787841797.364994:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877466496:0@lo:101: 00010000:00010000:3.0:1787841797.365024:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.365047:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841797.365130:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877466624:0@lo:501: 00000100:00100000:3.0:1787841797.365178:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.365222:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841797.365432:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466624 00000100:00100000:0.0:1787841797.365439:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466624 00000100:00100000:0.0:1787841797.365501:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787841797.365511:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877466624:12345-0@lo:501: 00000100:00100000:0.0:1787841797.366021:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877466624:12345-0@lo:501: Request processed in 510us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.366037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787841797.366325:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877466624:0@lo:501: 00000100:00100000:3.0:1787841797.366357:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877466752:0@lo:503: 00000100:00100000:3.0:1787841797.366411:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.366443:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841797.367025:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466752 00000100:00100000:0.0:1787841797.367119:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466752 00000100:00100000:0.0:1787841797.367197:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787841797.367206:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877466752:12345-0@lo:503: 00000100:00100000:0.0:1787841797.367591:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877466752:12345-0@lo:503: Request processed in 385us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.367599:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787841797.367693:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877466752:0@lo:503: 00000100:00100000:1.0:1787841797.377108:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382351680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8024:1874687877466880:0@lo:502: 00000100:00100000:3.0:1787841797.377707:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.377778:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485002f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841797.378107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877466880 00000100:00100000:0.0:1787841797.378117:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877466880 00000100:00100000:0.0:1787841797.378180:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787841797.378190:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:8024:x1874687877466880:12345-0@lo:502: 00000100:00100000:0.0:1787841797.378845:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:8024:x1874687877466880:12345-0@lo:502: Request processed in 655us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.378856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787841797.379150:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382351680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8024:1874687877466880:0@lo:502: 00000100:00100000:2.0:1787841797.379221:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8024:1874687877467008:0@lo:502: 00000100:00100000:2.0:1787841797.379260:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841797.379295:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff9463823c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841797.380742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467008 00000100:00100000:0.0:1787841797.380754:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467008 00000100:00100000:0.0:1787841797.380811:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787841797.380822:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:8024:x1874687877467008:12345-0@lo:502: 00000100:00100000:0.0:1787841797.381185:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:8024:x1874687877467008:12345-0@lo:502: Request processed in 364us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.381194:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787841797.381641:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8024:1874687877467008:0@lo:502: 00000040:00080000:3.0:1787841797.381676:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787841797.381862:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787841797.381885:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787841797.381898:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.381911:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841797.381932:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787841797.381934:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787841797.381937:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787841797.381970:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.381979:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.381989:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841797.382008:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467136:0@lo:101: 00000100:00100000:0.0:1787841797.382790:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.382847:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841797.383129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467136 00000100:00100000:1.0:1787841797.383136:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467136 00000100:00100000:1.0:1787841797.383189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787841797.383201:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877467136:12345-0@lo:101: 00010000:00010000:1.0:1787841797.383217:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841797.383233:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135e08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841797.383261:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841797.383273:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841797.383283:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498c00, rc 0) 00000100:00100000:1.0:1787841797.383407:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877467136:12345-0@lo:101: Request processed in 208us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841797.383414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787841797.388294:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467136:0@lo:101: 00010000:00010000:0.0:1787841797.388336:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.388361:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841797.388482:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467264:0@lo:501: 00000100:00100000:0.0:1787841797.388557:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.388605:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.392126:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467264 00000100:00100000:3.0:1787841797.392144:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467264 00000100:00100000:3.0:1787841797.392207:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787841797.392217:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877467264:12345-0@lo:501: 00000100:00100000:3.0:1787841797.392932:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877467264:12345-0@lo:501: Request processed in 713us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.392942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787841797.393072:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467264:0@lo:501: 00000100:00100000:1.0:1787841797.393133:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467392:0@lo:503: 00000100:00100000:1.0:1787841797.393182:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841797.393220:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485002f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.393367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467392 00000100:00100000:3.0:1787841797.393373:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467392 00000100:00100000:3.0:1787841797.393575:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787841797.393584:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877467392:12345-0@lo:503: 00000100:00100000:3.0:1787841797.393926:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877467392:12345-0@lo:503: Request processed in 342us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.393933:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787841797.393997:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467392:0@lo:503: 00000100:00100000:0.0:1787841797.394679:0:8027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8027:1874687877467520:0@lo:502: 00000100:00100000:0.0:1787841797.394741:0:8027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.394777:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.395477:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467520 00000100:00100000:3.0:1787841797.395483:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467520 00000100:00100000:3.0:1787841797.395531:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787841797.395541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:8027:x1874687877467520:12345-0@lo:502: 00000100:00100000:3.0:1787841797.395818:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:8027:x1874687877467520:12345-0@lo:502: Request processed in 278us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.395826:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787841797.396009:0:8027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8027:1874687877467520:0@lo:502: 00000020:01000000:0.0:1787841797.396040:0:8027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841797.396050:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841797.396052:0:8027:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787841797.396057:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787841797.396059:0:8027:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787841797.396081:0:8027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8027:1874687877467648:0@lo:502: 00000100:00100000:0.0:1787841797.396120:0:8027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.396147:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.396540:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467648 00000100:00100000:3.0:1787841797.396545:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467648 00000100:00100000:3.0:1787841797.396661:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787841797.396670:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:8027:x1874687877467648:12345-0@lo:502: 00000100:00100000:3.0:1787841797.396865:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:8027:x1874687877467648:12345-0@lo:502: Request processed in 196us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.396872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787841797.405056:0:8027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8027:1874687877467648:0@lo:502: 00000020:01000000:0.0:1787841797.405109:0:8027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841797.405121:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841797.405123:0:8027:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787841797.405129:0:8027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787841797.410562:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787841797.410605:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787841797.410620:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841797.410633:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841797.410643:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787841797.410646:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946485cca000 from 30 10000000:01000000:2.0:1787841797.410649:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787841797.410687:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841797.410694:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841797.410706:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841797.410738:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467776:0@lo:101: 00000100:00100000:2.0:1787841797.410803:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841797.411599:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9463823c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.411803:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467776 00000100:00100000:3.0:1787841797.411811:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467776 00000100:00100000:3.0:1787841797.411887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787841797.411896:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877467776:12345-0@lo:101: 00010000:00010000:3.0:1787841797.411914:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841797.411932:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135e16 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.411972:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.411983:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.411993:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dcc00, rc 0) 00000100:00100000:3.0:1787841797.412043:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877467776:12345-0@lo:101: Request processed in 148us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.412050:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787841797.412092:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467776:0@lo:101: 00010000:00010000:3.0:1787841797.412109:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.412119:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841797.412185:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467904:0@lo:501: 00000100:00100000:3.0:1787841797.412215:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.412222:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.412236:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877467904 00000100:00100000:3.0:1787841797.412239:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877467904 00000100:00100000:3.0:1787841797.412252:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787841797.412257:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877467904:12345-0@lo:501: 00000100:00100000:3.0:1787841797.412964:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877467904:12345-0@lo:501: Request processed in 703us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.412974:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787841797.418065:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877467904:0@lo:501: 00000100:00100000:3.0:1787841797.418236:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468032:0@lo:503: 00000100:00100000:3.0:1787841797.418337:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.418381:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841797.418510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468032 00000100:00100000:2.0:1787841797.418523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468032 00000100:00100000:2.0:1787841797.418574:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787841797.418583:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877468032:12345-0@lo:503: 00000100:00100000:2.0:1787841797.418808:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877468032:12345-0@lo:503: Request processed in 224us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841797.418816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787841797.418933:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468032:0@lo:503: 00000100:00100000:0.0:1787841797.420130:0:8029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8029:1874687877468160:0@lo:502: 00000100:00100000:0.0:1787841797.420195:0:8029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.420240:0:8029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.420302:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468160 00000100:00100000:3.0:1787841797.420318:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468160 00000100:00100000:3.0:1787841797.420370:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787841797.420380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:8029:x1874687877468160:12345-0@lo:502: 00000100:00100000:3.0:1787841797.420623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:8029:x1874687877468160:12345-0@lo:502: Request processed in 245us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.420631:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787841797.421107:0:8029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8029:1874687877468160:0@lo:502: 00000100:00100000:0.0:1787841797.421155:0:8029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8029:1874687877468288:0@lo:502: 00000100:00100000:0.0:1787841797.421190:0:8029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.421221:0:8029:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.421263:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468288 00000100:00100000:3.0:1787841797.421268:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468288 00000100:00100000:3.0:1787841797.421304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787841797.421320:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:8029:x1874687877468288:12345-0@lo:502: 00000100:00100000:3.0:1787841797.428427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:8029:x1874687877468288:12345-0@lo:502: Request processed in 7095us (7223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.428442:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787841797.428595:0:8029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8029:1874687877468288:0@lo:502: 00000040:00080000:0.0:1787841797.428635:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787841797.429319:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787841797.429349:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787841797.429363:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.429376:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841797.429387:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787841797.429389:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946485cca000 from 5 10000000:01000000:3.0:1787841797.429392:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787841797.429434:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.429443:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.429472:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841797.429492:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468416:0@lo:101: 00000100:00100000:3.0:1787841797.429539:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.429575:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.429594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468416 00000100:00100000:3.0:1787841797.429600:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468416 00000100:00100000:3.0:1787841797.429641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787841797.429650:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877468416:12345-0@lo:101: 00010000:00010000:3.0:1787841797.429662:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841797.429676:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135e2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135e24 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.429701:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135e24 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.429711:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e24 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.429731:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dc800, rc 0) 00000100:00100000:3.0:1787841797.429761:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877468416:12345-0@lo:101: Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.429767:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787841797.429811:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468416:0@lo:101: 00010000:00010000:3.0:1787841797.429823:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.430066:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841797.430113:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468544:0@lo:256: 00000100:00100000:3.0:1787841797.430143:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.430193:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.430204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468544 00000100:00100000:3.0:1787841797.430207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468544 00000100:00100000:0.0:1787841797.433106:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787841797.433146:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877468544:12345-0@lo:256: 20000000:01000000:0.0:1787841797.433178:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787841797.433201:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787841797.433204:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787841797.433991:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877468544:12345-0@lo:256: Request processed in 867us (3843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.434001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787841797.437658:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468544:0@lo:256: 10000000:01000000:0.0:1787841797.437787:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787841797.437801:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.437812:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841797.437821:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787841797.437823:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787841797.437827:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787841797.437885:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.437894:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.437904:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841797.437923:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468672:0@lo:101: 00000100:00100000:0.0:1787841797.437989:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.438040:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.438133:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468672 00000100:00100000:3.0:1787841797.438140:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468672 00000100:00100000:3.0:1787841797.438194:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787841797.438203:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877468672:12345-0@lo:101: 00010000:00010000:3.0:1787841797.438218:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841797.438230:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135e32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.438256:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.438273:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.438283:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dd800, rc 0) 00000100:00100000:3.0:1787841797.438344:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877468672:12345-0@lo:101: Request processed in 142us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.438361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787841797.438734:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468672:0@lo:101: 00010000:00010000:1.0:1787841797.438749:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841797.438759:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841797.438822:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468800:0@lo:501: 00000100:00100000:1.0:1787841797.438851:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841797.438879:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464837d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.440353:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468800 00000100:00100000:3.0:1787841797.440369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468800 00000100:00100000:3.0:1787841797.440423:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787841797.440433:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877468800:12345-0@lo:501: 00000100:00100000:3.0:1787841797.440787:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877468800:12345-0@lo:501: Request processed in 353us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.440795:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787841797.441012:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468800:0@lo:501: 00000100:00100000:1.0:1787841797.441071:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468928:0@lo:503: 00000100:00100000:1.0:1787841797.441117:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841797.441133:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464837d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.442441:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877468928 00000100:00100000:3.0:1787841797.442475:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877468928 00000100:00100000:3.0:1787841797.442524:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787841797.442532:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877468928:12345-0@lo:503: 00000100:00100000:3.0:1787841797.442912:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877468928:12345-0@lo:503: Request processed in 379us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.442919:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787841797.442983:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877468928:0@lo:503: 00000100:00100000:2.0:1787841797.445932:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbce580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8032:1874687877469056:0@lo:502: 00000100:00100000:2.0:1787841797.446019:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841797.446053:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9463823c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.446182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469056 00000100:00100000:3.0:1787841797.446190:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469056 00000100:00100000:3.0:1787841797.446238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787841797.446248:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:8032:x1874687877469056:12345-0@lo:502: 00000100:00100000:3.0:1787841797.446710:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:8032:x1874687877469056:12345-0@lo:502: Request processed in 463us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.446729:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787841797.446845:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbce580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8032:1874687877469056:0@lo:502: 00000020:01000000:2.0:1787841797.446876:0:8032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787841797.446883:0:8032:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787841797.446890:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841797.446892:0:8032:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787841797.446898:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787841797.446901:0:8032:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.146@tcp to nid 0x20000c0a8ca92 (192.168.202.146@tcp) 00000020:01000000:2.0:1787841797.446924:0:8032:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787841797.446926:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787841797.446942:0:8032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9463826db490) 00000020:00000080:2.0:1787841797.446965:0:8032:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787841797.446969:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787841797.447034:0:8032:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787841797.447038:0:8032:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787841797.447058:0:8032:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e135e47 00010000:00080000:2.0:1787841797.447087:0:8032:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9464bf97a800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.146@tcp at head 00010000:00010000:2.0:1787841797.447303:0:8032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787841797.447965:0:8032:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787841797.447991:0:8032:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787841797.449213:0:8032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787841797.449807:0:8032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787841797.449888:0:8032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787841797.449949:0:8032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787841797.454628:0:8035:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841797.454636:0:8035:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787841797.461191:0:8032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787841797.461207:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787841797.461249:0:8032:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787841797.461277:0:8032:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e135e4e 00000100:00080000:3.0:1787841797.461288:0:8032:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841797.461295:0:8032:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464bf97a800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:3.0:1787841797.461350:0:8032:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464b980e580 x1874687877469184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841797.472800:0:8032:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787841797.472923:0:8032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841797.472932:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841797.472934:0:8032:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787841797.472939:0:8032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841797.472943:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841797.472945:0:8032:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841797.472948:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841797.472949:0:8032:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787841797.472999:0:8032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8032:1874687877469312:0@lo:502: 00000100:00100000:3.0:1787841797.473095:0:8032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.473134:0:8032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464837d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.474600:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877469440:0@lo:400: 00000100:00100000:3.0:1787841797.474663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.474710:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841797.474729:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877469824:0@lo:400: 00000100:00100000:3.0:1787841797.474753:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.474784:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877469568:0@lo:400: 00000100:00100000:3.0:1787841797.474807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.474827:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841797.476224:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469312 00000100:00100000:2.0:1787841797.476240:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469312 00000100:00100000:2.0:1787841797.476300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787841797.476312:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:8032:x1874687877469312:12345-0@lo:502: 00000100:00100000:1.0:1787841797.476553:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877469184:0@lo:8: 00000100:00100000:3.0:1787841797.476592:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877469696:0@lo:400: 00000100:00100000:1.0:1787841797.476622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.476633:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469440 00000100:00100000:3.0:1787841797.476639:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469440 00000100:00100000:3.0:1787841797.476669:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469824 00000100:00100000:3.0:1787841797.476672:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469824 00000100:00100000:2.0:1787841797.476682:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:8032:x1874687877469312:12345-0@lo:502: Request processed in 370us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841797.476691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787841797.476705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469568 00000100:00100000:3.0:1787841797.476710:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469568 00000100:00100000:3.0:1787841797.476741:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787841797.476749:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877469440:12345-0@lo:400: 00000100:00100000:3.0:1787841797.476808:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877469440:12345-0@lo:400: Request processed in 60us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.476815:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787841797.476829:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787841797.476835:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877469824:12345-0@lo:400: 00000100:00100000:3.0:1787841797.476876:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877469824:12345-0@lo:400: Request processed in 41us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.476882:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787841797.476892:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787841797.476900:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877469568:12345-0@lo:400: 00000100:00100000:3.0:1787841797.476926:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877469568:12345-0@lo:400: Request processed in 29us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.476932:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787841797.476987:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980d680 x1874687877469824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841797.477002:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877469824:0@lo:400: 00010000:00080000:3.0:1787841797.477014:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980f0c0 x1874687877469440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841797.477023:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877469440:0@lo:400: 00000100:00100000:3.0:1787841797.477053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787841797.477087:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980e940 x1874687877469568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841797.477095:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877469568:0@lo:400: 00000100:00100000:3.0:1787841797.477117:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469184 00000100:00100000:3.0:1787841797.477120:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469184 00000100:00100000:3.0:1787841797.477137:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469696 00000100:00100000:3.0:1787841797.477140:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469696 00000100:00100000:3.0:1787841797.477157:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841797.477162:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877469696:12345-0@lo:400: 00000100:00100000:3.0:1787841797.477196:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877469696:12345-0@lo:400: Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.477202:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841797.477213:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841797.477216:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874687877469184:12345-0@lo:8: 00010000:00080000:3.0:1787841797.477239:0:6693:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1787841797.477267:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e135e55 00002000:00100000:3.0:1787841797.477284:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9463827d5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787841797.477289:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787841797.477294:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787841797.477967:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787841797.478158:0:6693:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787841797.478188:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9463827d6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841797.478255:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874687877469184:12345-0@lo:8: Request processed in 1036us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.478264:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787841797.478566:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980e580 x1874687877469184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787841807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841797.478587:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787841797.478595:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787841797.478604:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787841797.478610:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787841797.478613:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464bf97a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787841797.478629:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787841797.478635:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877469184:0@lo:8: 00010000:00080000:3.0:1787841797.478672:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980cf00 x1874687877469696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841797.478681:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877469696:0@lo:400: 00000100:00100000:3.0:1787841797.478726:0:8032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8032:1874687877469312:0@lo:502: 00000020:01000000:3.0:1787841797.478763:0:8032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841797.478770:0:8032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841797.478772:0:8032:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787841797.478777:0:8032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1787841797.478827:0:8035:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1787841797.478879:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841797.478886:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787841797.478954:0:8035:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 186453495738ns, next at 0ns, rc = 0 00000020:01000000:0.0:1787841797.488385:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787841797.488426:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787841797.488439:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.488453:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841797.488482:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787841797.488485:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9464871a4ed8 from 1 10000000:01000000:0.0:1787841797.488488:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787841797.488530:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.488538:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841797.488551:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841797.488576:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877469952:0@lo:101: 00000100:00100000:0.0:1787841797.488652:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.488694:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.492517:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877469952 00000100:00100000:3.0:1787841797.492535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877469952 00000100:00100000:3.0:1787841797.492602:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787841797.492613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877469952:12345-0@lo:101: 00010000:00010000:3.0:1787841797.492635:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841797.492655:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135e5c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.492688:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.492701:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.492729:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dc000, rc 0) 00000100:00100000:3.0:1787841797.492811:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877469952:12345-0@lo:101: Request processed in 200us (4159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.492818:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787841797.493184:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877469952:0@lo:101: 00010000:00010000:3.0:1787841797.493204:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.493215:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841797.493288:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877470080:0@lo:501: 00000100:00100000:3.0:1787841797.493324:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.493355:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464857d03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.493369:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470080 00000100:00100000:3.0:1787841797.493372:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470080 00000100:00100000:3.0:1787841797.493395:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787841797.493402:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877470080:12345-0@lo:501: 00000100:00100000:3.0:1787841797.493663:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877470080:12345-0@lo:501: Request processed in 260us (338us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841797.493670:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787841797.496012:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877470080:0@lo:501: 10000000:01000000:3.0:1787841797.496059:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787841797.496071:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841797.496093:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841797.522747:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787841797.522839:0:8036:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787841797.522870:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470336:0@lo:7: 00000100:00100000:3.0:1787841797.522875:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877470208:0@lo:13: 00000100:00100000:0.0:1787841797.523012:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.523092:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787841797.524849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841797.524931:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470208 00000100:00100000:3.0:1787841797.524941:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470208 00000100:00080000:1.0:1787841797.524983:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841797.525011:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787841797.525023:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877470208:12345-0@lo:13: 00002000:00000024:3.0:1787841797.525070:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787841797.525150:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877470208:12345-0@lo:13: Request processed in 129us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.525158:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787841797.525209:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e9a40 x1874687877470208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841797.525229:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877470208:0@lo:13: 00000100:00100000:2.0:1787841797.529525:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470336 00000100:00100000:2.0:1787841797.529545:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470336 00000100:00100000:2.0:1787841797.529903:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841797.529917:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8036:x1874687877470336:12345-0@lo:7: 00002000:00080000:2.0:1787841797.538863:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787841797.538872:0:6694:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787841797.539026:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8036:x1874687877470336:12345-0@lo:7: Request processed in 9107us (16008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841797.539037:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787841797.539137:0:8036:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e8780 x1874687877470336/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787841813 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841797.539163:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470336:0@lo:7: 00000004:00080000:0.0:1787841797.539179:0:8036:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787841797.539223:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470464:0@lo:5: 00000100:00100000:0.0:1787841797.539261:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.539323:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841797.539411:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470464 00000100:00100000:1.0:1787841797.539419:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470464 00000100:00100000:1.0:1787841797.539549:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841797.539560:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8036:x1874687877470464:12345-0@lo:5: 00002000:00080000:1.0:1787841797.539590:0:6691:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787841797.539594:0:6691:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787841797.539884:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8036:x1874687877470464:12345-0@lo:5: Request processed in 325us (620us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787841797.539891:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787841797.540023:0:8036:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e8780 x1874687877470464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841813 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841797.540037:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470464:0@lo:5: 00000004:00080000:0.0:1787841797.540047:0:8036:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787841797.540073:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470592:0@lo:700: 00000100:00100000:0.0:1787841797.540099:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841797.540116:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841797.540167:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470592 00000100:00100000:2.0:1787841797.540172:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470592 00000100:00100000:2.0:1787841797.540234:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841797.540243:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8036:x1874687877470592:12345-0@lo:700: 00000100:00100000:2.0:1787841797.540282:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbce580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1874687877470720:0@lo:700: 00000100:00100000:2.0:1787841797.540314:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841797.540332:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9463823c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841797.540359:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470720 00000100:00100000:2.0:1787841797.540362:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470720 00000100:00100000:2.0:1787841797.540389:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841797.540396:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1874687877470720:12345-0@lo:700: 00010000:00010000:3.0:1787841797.553565:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1787841797.592292:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787841797.598887:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1874687877470720:12345-0@lo:700: Request processed in 58478us (58558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841797.598905:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787841797.599043:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfbce580 x1874687877470720/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787841813 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841797.599059:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbce580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1874687877470720:0@lo:700: 40000000:02000000:0.0:1787841797.599075:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787841797.748909:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787841797.748929:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787841797.749301:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8036:x1874687877470592:12345-0@lo:700: Request processed in 209054us (209195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841797.749314:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787841797.757663:0:8036:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98ea1c0 x1874687877470592/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787841813 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841797.757680:0:8036:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787841797.757705:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470592:0@lo:700: 00000004:02000040:1.0:1787841797.846555:0:8036:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787841797.858218:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbce940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470848:0@lo:5: 00000100:00100000:2.0:1787841797.858298:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841797.858366:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470848 00000100:00100000:2.0:1787841797.858381:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470848 00000100:00100000:2.0:1787841797.858437:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841797.858448:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8036:x1874687877470848:12345-0@lo:5: 00000100:00100000:0.0:1787841797.866798:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648325ce40 going to sleep for 11 seconds 00002000:00080000:2.0:1787841797.870987:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787841797.871010:0:6693:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787841797.881696:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8036:x1874687877470848:12345-0@lo:5: Request processed in 23236us (23384us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787841797.881721:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787841797.885643:0:8036:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfbce940 x1874687877470848/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841813 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841797.885670:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbce940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8036:1874687877470848:0@lo:5: 00000004:00080000:0.0:1787841797.885692:0:8036:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787841798.388088:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877470976:0@lo:13: 00000100:00100000:0.0:1787841798.388168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841798.388906:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877470976 00000100:00100000:1.0:1787841798.388916:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877470976 00000100:00100000:1.0:1787841798.388965:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841798.388974:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877470976:12345-0@lo:13: 00002000:00000024:1.0:1787841798.394326:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841798.394453:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877470976:12345-0@lo:13: Request processed in 5473us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841798.394481:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787841798.395869:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980cf00 x1874687877470976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841798.395897:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877470976:0@lo:13: 00010000:00010000:3.0:1787841798.617000:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841799.665791:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841800.693029:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841801.723816:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787841802.329187:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1787841802.482344:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877471104:0@lo:400: 00000100:00100000:3.0:1787841802.482473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841802.482532:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877471616:0@lo:400: 00000100:00100000:3.0:1787841802.482574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841802.482604:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841802.482610:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877471488:0@lo:400: 00000100:00100000:3.0:1787841802.482645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841802.482688:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877471232:0@lo:400: 00000100:00100000:3.0:1787841802.482721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841802.482747:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877471744:0@lo:400: 00000100:00100000:3.0:1787841802.482768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841802.482800:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841802.482806:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877471360:0@lo:400: 00000100:00100000:3.0:1787841802.483029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841802.483067:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471104 00000100:00100000:3.0:1787841802.483075:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471104 00000100:00100000:3.0:1787841802.483130:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787841802.483139:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877471104:12345-0@lo:400: 00000100:00100000:3.0:1787841802.483205:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877471104:12345-0@lo:400: Request processed in 67us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841802.483214:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787841802.483254:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471616 00000100:00100000:3.0:1787841802.483259:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471616 00000100:00100000:3.0:1787841802.483426:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471232 00000100:00100000:3.0:1787841802.483431:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471232 00000100:00100000:3.0:1787841802.483445:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471360 00000100:00100000:3.0:1787841802.483447:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471360 00000100:00100000:3.0:1787841802.483497:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787841802.483504:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877471616:12345-0@lo:400: 00000100:00100000:3.0:1787841802.483541:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877471616:12345-0@lo:400: Request processed in 37us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841802.483558:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787841802.483570:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787841802.483576:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877471232:12345-0@lo:400: 00000100:00100000:3.0:1787841802.483608:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877471232:12345-0@lo:400: Request processed in 33us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841802.483614:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787841802.483623:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787841802.483629:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877471360:12345-0@lo:400: 00000100:00100000:3.0:1787841802.483651:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877471360:12345-0@lo:400: Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841802.483656:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787841802.483683:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471488 00000100:00100000:3.0:1787841802.483687:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471488 00000100:00100000:3.0:1787841802.483715:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471744 00000100:00100000:3.0:1787841802.483718:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471744 00000100:00100000:3.0:1787841802.483732:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841802.483739:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877471488:12345-0@lo:400: 00000100:00100000:3.0:1787841802.483770:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877471488:12345-0@lo:400: Request processed in 32us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841802.483776:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841802.483787:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841802.483793:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877471744:12345-0@lo:400: 00000100:00100000:3.0:1787841802.484413:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877471744:12345-0@lo:400: Request processed in 617us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841802.484423:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787841802.484540:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841802.484545:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841802.484548:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787841802.484584:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980f480 x1874687877471488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841802.484613:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877471488:0@lo:400: 00000100:00100000:2.0:1787841802.484627:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877471104:0@lo:400: 00010000:00080000:2.0:1787841802.484637:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980de00 x1874687877471616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841802.484646:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877471616:0@lo:400: 00010000:00080000:3.0:1787841802.484737:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980f840 x1874687877471360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841802.484754:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877471360:0@lo:400: 00010000:00080000:3.0:1787841802.484768:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980da40 x1874687877471232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841802.484777:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877471232:0@lo:400: 00010000:00080000:3.0:1787841802.484787:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980e1c0 x1874687877471744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841802.484794:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787841802.484805:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877471744:0@lo:400: 00010000:00010000:3.0:1787841802.738251:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841803.003673:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841803.003710:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877471872:0@lo:13: 00000100:00100000:0.0:1787841803.003789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841803.003966:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877471872 00000100:00100000:1.0:1787841803.003974:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877471872 00000100:00100000:1.0:1787841803.004025:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787841803.004034:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877471872:12345-0@lo:13: 00002000:00000024:1.0:1787841803.004073:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841803.004127:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877471872:12345-0@lo:13: Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841803.004134:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787841803.004170:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e92c0 x1874687877471872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841803.004194:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877471872:0@lo:13: 00000100:00100000:0.0:1787841803.506825:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877472000:0@lo:13: 00000100:00100000:0.0:1787841803.506901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841803.507598:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472000 00000100:00100000:1.0:1787841803.507609:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472000 00000100:00100000:1.0:1787841803.507692:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841803.507703:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877472000:12345-0@lo:13: 00002000:00000024:1.0:1787841803.507745:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841803.507841:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877472000:12345-0@lo:13: Request processed in 139us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841803.507849:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787841803.508098:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980e1c0 x1874687877472000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841803.508119:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877472000:0@lo:13: 00010000:00010000:0.0:1787841803.761900:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841804.118583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841804.118833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858573696 00000100:00100000:3.0:1787841804.118845:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858573696 00000100:00100000:3.0:1787841804.118905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 113 00000100:00100000:3.0:1787841804.118915:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2345:x1874687858573696:12345-192.168.202.46@tcp:250: 00010000:00080000:3.0:1787841804.118952:0:5844:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3ec827ec-b678-4253-8ad7-a0e8fdbfe846@192.168.202.46@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1787841804.118985:0:5844:0:(genops.c:1385:class_connect()) connect: client 3ec827ec-b678-4253-8ad7-a0e8fdbfe846, cookie 0x1d0ed3605e135e6a 00000100:00080000:3.0:1787841804.119169:0:5844:0:(import.c:65:import_set_state_nolock()) ffff946381fa5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841804.119251:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+5:2345:x1874687858573696:12345-192.168.202.46@tcp:250: Request processed in 336us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841804.119259:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 113 00000100:00100000:1.0:1787841804.123959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841804.125943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858573568 00000100:00100000:3.0:1787841804.125963:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858573568 00000100:00100000:3.0:1787841804.126057:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 114 00000100:00100000:3.0:1787841804.126069:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+5:5575:x1874687858573568:12345-192.168.202.46@tcp:101: 00010000:00010000:3.0:1787841804.126091:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841804.126142:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97926 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841804.126181:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841804.126195:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841804.126207:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dc600, rc 0) 00000100:00100000:3.0:1787841804.126297:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+6:5575:x1874687858573568:12345-192.168.202.46@tcp:101: Request processed in 229us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841804.126304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 114 00000100:00100000:1.0:1787841804.137157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841804.137810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858573824 00000100:00100000:3.0:1787841804.137822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858573824 00000100:00100000:3.0:1787841804.137896:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 115 00000100:00100000:3.0:1787841804.137907:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+6:5575:x1874687858573824:12345-192.168.202.46@tcp:501: 00000100:00100000:3.0:1787841804.138389:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+6:5575:x1874687858573824:12345-192.168.202.46@tcp:501: Request processed in 479us (1242us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841804.138398:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 115 00000100:00100000:2.0:1787841804.148348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.148975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858573952 00000100:00100000:0.0:1787841804.148988:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858573952 00000100:00100000:0.0:1787841804.149060:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:0.0:1787841804.149070:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+6:5575:x1874687858573952:12345-192.168.202.46@tcp:101: 00010000:00010000:0.0:1787841804.149094:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841804.151549:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d9792d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841804.151611:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841804.151647:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841804.151672:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481400, rc 0) 00000100:00100000:0.0:1787841804.151749:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+7:5575:x1874687858573952:12345-192.168.202.46@tcp:101: Request processed in 2680us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.151759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:1.0:1787841804.162057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.163328:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574080 00000100:00100000:0.0:1787841804.163344:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574080 00000100:00100000:0.0:1787841804.163417:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:0.0:1787841804.163428:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+7:5575:x1874687858574080:12345-192.168.202.46@tcp:501: 00000100:00100000:0.0:1787841804.164111:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5575:x1874687858574080:12345-192.168.202.46@tcp:501: Request processed in 680us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.164121:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:1.0:1787841804.170626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.170820:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574208 00000100:00100000:0.0:1787841804.170831:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574208 00000100:00100000:0.0:1787841804.170883:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 118 00000100:00100000:0.0:1787841804.170893:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5575:x1874687858574208:12345-192.168.202.46@tcp:503: 00000100:00100000:0.0:1787841804.171674:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5575:x1874687858574208:12345-192.168.202.46@tcp:503: Request processed in 778us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.171685:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 118 00000100:00100000:2.0:1787841804.181989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.182713:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574336 00000100:00100000:0.0:1787841804.182727:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574336 00000100:00100000:0.0:1787841804.182820:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 119 00000100:00100000:0.0:1787841804.182832:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5593:x1874687858574336:12345-192.168.202.46@tcp:502: 00000100:00100000:0.0:1787841804.183273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5593:x1874687858574336:12345-192.168.202.46@tcp:502: Request processed in 441us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.183281:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 119 00000100:00100000:1.0:1787841804.231394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.231511:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574464 00000100:00100000:0.0:1787841804.231523:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574464 00000100:00100000:0.0:1787841804.231588:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 120 00000100:00100000:0.0:1787841804.231599:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5593:x1874687858574464:12345-192.168.202.46@tcp:502: 00000100:00100000:0.0:1787841804.231980:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5593:x1874687858574464:12345-192.168.202.46@tcp:502: Request processed in 382us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.231989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 120 00000100:00100000:1.0:1787841804.248541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841804.248695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574592 00000100:00100000:3.0:1787841804.248706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574592 00000100:00100000:3.0:1787841804.248785:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:3.0:1787841804.248796:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5575:x1874687858574592:12345-192.168.202.46@tcp:101: 00010000:00010000:3.0:1787841804.248818:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841804.248848:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dc200/0x1d0ed3605e135e7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97957 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841804.248908:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dc200/0x1d0ed3605e135e7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97957 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841804.248921:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dc200/0x1d0ed3605e135e7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97957 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841804.248933:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dc200, rc 0) 00000100:00100000:3.0:1787841804.249002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5575:x1874687858574592:12345-192.168.202.46@tcp:101: Request processed in 206us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841804.249009:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:2.0:1787841804.255425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.255573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574720 00000100:00100000:0.0:1787841804.255584:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574720 00000100:00100000:0.0:1787841804.255651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:0.0:1787841804.255750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5575:x1874687858574720:12345-192.168.202.46@tcp:256: 20000000:01000000:0.0:1787841804.255782:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787841804.255931:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787841804.255936:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787841804.255939:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787841804.255941:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787841804.268713:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5575:x1874687858574720:12345-192.168.202.46@tcp:256: Request processed in 12952us (13287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.268731:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:1.0:1787841804.278139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.278236:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574848 00000100:00100000:0.0:1787841804.278248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574848 00000100:00100000:0.0:1787841804.278311:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 123 00000100:00100000:0.0:1787841804.278322:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5575:x1874687858574848:12345-192.168.202.46@tcp:101: 00010000:00010000:0.0:1787841804.278365:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841804.278391:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d9795e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841804.278428:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841804.278442:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841804.278453:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481000, rc 0) 00000100:00100000:0.0:1787841804.278564:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5575:x1874687858574848:12345-192.168.202.46@tcp:101: Request processed in 244us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.278571:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 123 00000100:00100000:2.0:1787841804.283211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.284036:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858574976 00000100:00100000:0.0:1787841804.284049:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858574976 00000100:00100000:0.0:1787841804.284115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 124 00000100:00100000:0.0:1787841804.284126:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5575:x1874687858574976:12345-192.168.202.46@tcp:501: 00000100:00100000:0.0:1787841804.285151:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5575:x1874687858574976:12345-192.168.202.46@tcp:501: Request processed in 1017us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.285163:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 124 00000100:00100000:1.0:1787841804.293942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841804.294643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575104 00000100:00100000:3.0:1787841804.294945:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575104 00000100:00100000:3.0:1787841804.295025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 125 00000100:00100000:3.0:1787841804.295037:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5575:x1874687858575104:12345-192.168.202.46@tcp:503: 00000100:00100000:2.0:1787841804.297712:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5575:x1874687858575104:12345-192.168.202.46@tcp:503: Request processed in 2663us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841804.297728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 125 00000100:00100000:1.0:1787841804.309294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841804.309693:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575232 00000100:00100000:0.0:1787841804.309707:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575232 00000100:00100000:0.0:1787841804.309802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 126 00000100:00100000:0.0:1787841804.309815:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5597:x1874687858575232:12345-192.168.202.46@tcp:502: 00000100:00100000:0.0:1787841804.310453:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5597:x1874687858575232:12345-192.168.202.46@tcp:502: Request processed in 636us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841804.310589:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 126 00000100:00100000:1.0:1787841804.317432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841804.317622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575360 00000100:00100000:2.0:1787841804.317633:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575360 00000100:00100000:2.0:1787841804.317706:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 127 00000100:00100000:2.0:1787841804.317717:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5597:x1874687858575360:12345-192.168.202.46@tcp:502: 00000100:00100000:2.0:1787841804.318003:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5597:x1874687858575360:12345-192.168.202.46@tcp:502: Request processed in 286us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841804.318011:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 127 00000100:00100000:1.0:1787841804.323392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841804.323505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575488 00000100:00100000:3.0:1787841804.323515:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575488 00000100:00100000:3.0:1787841804.323575:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:3.0:1787841804.323584:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1874687858575488:12345-192.168.202.46@tcp:38: 00010000:00080000:3.0:1787841804.323618:0:5849:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1787841804.323689:0:5849:0:(genops.c:1385:class_connect()) connect: client 7142e368-78a3-4f67-bb12-5e4ed629eb65, cookie 0x1d0ed3605e135e8d 00000004:00100000:3.0:1787841804.323729:0:5849:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787841804.323736:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787841804.380021:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9464b9805000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841804.380286:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2345:x1874687858575488:12345-192.168.202.46@tcp:38: Request processed in 56698us (56904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841804.380302:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00010000:00010000:3.0:1787841804.787001:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841805.388739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841805.388781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841805.388918:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575616 00000100:00100000:0.0:1787841805.388929:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575616 00000100:00100000:0.0:1787841805.388999:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575744 00000100:00100000:0.0:1787841805.389003:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575744 00000100:00100000:0.0:1787841805.389018:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787841805.389026:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:0:x1874687858575616:12345-192.168.202.46@tcp:41: 00000100:00080000:2.0:1787841805.389071:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787841805.389076:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787841805.389416:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:0:x1874687858575616:12345-192.168.202.46@tcp:41: Request processed in 388us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.389426:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787841805.389452:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:0.0:1787841805.389501:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5575:x1874687858575744:12345-192.168.202.46@tcp:41: 00000004:00000024:0.0:1787841805.389515:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787841805.389543:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5575:x1874687858575744:12345-192.168.202.46@tcp:41: Request processed in 84us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.389549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:3.0:1787841805.394786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841805.395871:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858575872 00000100:00100000:0.0:1787841805.395885:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858575872 00000100:00100000:0.0:1787841805.395965:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:0.0:1787841805.395977:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5575:x1874687858575872:12345-192.168.202.46@tcp:40: 00000100:00100000:0.0:1787841805.396104:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5575:x1874687858575872:12345-192.168.202.46@tcp:40: Request processed in 128us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.396120:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787841805.403554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841805.403594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841805.403622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841805.403666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841805.403703:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576000 00000100:00100000:2.0:1787841805.403715:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576000 00000100:00100000:2.0:1787841805.403766:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576128 00000100:00100000:2.0:1787841805.403769:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576128 00000100:00100000:2.0:1787841805.403787:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:2.0:1787841805.403795:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874687858576000:12345-192.168.202.46@tcp:8: 00010000:00080000:2.0:1787841805.403837:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1787841805.403869:0:6694:0:(genops.c:1385:class_connect()) connect: client 7142e368-78a3-4f67-bb12-5e4ed629eb65, cookie 0x1d0ed3605e135e94 00002000:00100000:2.0:1787841805.403881:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7142e368-78a3-4f67-bb12-5e4ed629eb65/ffff9464bf97f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841805.403904:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787841805.403918:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576256 00000100:00100000:3.0:1787841805.403924:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576256 00000100:00100000:3.0:1787841805.403993:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:3.0:1787841805.404003:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5575:x1874687858576256:12345-192.168.202.46@tcp:33: 00002000:00080000:2.0:1787841805.404254:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787841805.404284:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9464bf97d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841805.404344:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2345:x1874687858576000:12345-192.168.202.46@tcp:8: Request processed in 549us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841805.404352:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:2.0:1787841805.404370:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:2.0:1787841805.404375:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874687858576128:12345-192.168.202.46@tcp:8: 00010000:00080000:2.0:1787841805.404390:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1787841805.404407:0:6694:0:(genops.c:1385:class_connect()) connect: client 7142e368-78a3-4f67-bb12-5e4ed629eb65, cookie 0x1d0ed3605e135e9b 00002000:00100000:2.0:1787841805.404412:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7142e368-78a3-4f67-bb12-5e4ed629eb65/ffff9464bf978800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841805.404434:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841805.404713:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787841805.404728:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9464bf97b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841805.404750:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2345:x1874687858576128:12345-192.168.202.46@tcp:8: Request processed in 374us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841805.404756:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:0.0:1787841805.406192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576384 00000100:00100000:0.0:1787841805.406231:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576384 00000100:00100000:0.0:1787841805.406307:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 128 00000100:00100000:0.0:1787841805.406318:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2346:x1874687858576384:12345-192.168.202.46@tcp:400: 00000100:00100000:0.0:1787841805.406388:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2346:x1874687858576384:12345-192.168.202.46@tcp:400: Request processed in 72us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.406395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 128 00000004:00080000:3.0:1787841805.442559:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38477us 00000004:00200000:2.0:1787841805.476125:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787841805.476506:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5575:x1874687858576256:12345-192.168.202.46@tcp:33: Request processed in 72497us (72956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841805.476522:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:2.0:1787841805.725887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841805.726020:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576512 00000100:00100000:1.0:1787841805.726031:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576512 00000100:00100000:1.0:1787841805.726102:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:1.0:1787841805.726116:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5614:x1874687858576512:12345-192.168.202.46@tcp:101: 00010000:00010000:1.0:1787841805.726143:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841805.726214:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499c00/0x1d0ed3605e135ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97988 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841805.726295:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e135ea9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841805.726313:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e135ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841805.726331:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e135ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841805.726634:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787841805.726638:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841805.726733:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e135ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841805.726781:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499c00/0x1d0ed3605e135ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97988 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841805.726803:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e135ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97988 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841805.726812:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94649317a300) 00010000:00010000:1.0:1787841805.726816:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841805.726820:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499a00, rc 0) 00000100:00100000:1.0:1787841805.726895:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:5614:x1874687858576512:12345-192.168.202.46@tcp:101: Request processed in 781us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841805.726903:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00010000:00010000:3.0:1787841805.809705:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841806.833661:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841807.603181:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877472128:0@lo:400: 00000100:00100000:1.0:1787841807.603271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841807.603398:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472128 00000100:00100000:2.0:1787841807.603408:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472128 00000100:00100000:2.0:1787841807.603480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787841807.603491:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877472128:12345-0@lo:400: 00000100:00100000:0.0:1787841807.604479:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877472256:0@lo:400: 00000100:00100000:0.0:1787841807.604541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841807.604580:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841807.604587:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877472384:0@lo:400: 00000100:00100000:0.0:1787841807.604610:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841807.604650:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472256 00000100:00100000:0.0:1787841807.604656:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472256 00000100:00100000:0.0:1787841807.604695:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472384 00000100:00100000:0.0:1787841807.604698:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472384 00000100:00100000:0.0:1787841807.604725:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841807.604734:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877472256:12345-0@lo:400: 00000100:00100000:0.0:1787841807.604793:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877472256:12345-0@lo:400: Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841807.604800:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841807.604817:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787841807.604824:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877472384:12345-0@lo:400: 00000100:00100000:0.0:1787841807.604848:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877472384:12345-0@lo:400: Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841807.604863:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787841807.604883:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841807.604914:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877472384:0@lo:400: 00000100:00100000:0.0:1787841807.604941:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877472256:0@lo:400: 00000100:00100000:0.0:1787841807.605015:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877472512:0@lo:400: 00000100:00100000:0.0:1787841807.605044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841807.605082:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472512 00000100:00100000:0.0:1787841807.605085:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472512 00000100:00100000:0.0:1787841807.605116:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841807.605123:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877472512:12345-0@lo:400: 00000100:00100000:0.0:1787841807.605155:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877472512:12345-0@lo:400: Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841807.605162:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787841807.605175:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787841807.605190:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980de00 x1874687877472512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841807.605200:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877472512:0@lo:400: 00000100:00100000:2.0:1787841807.610553:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877472128:12345-0@lo:400: Request processed in 7049us (7266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841807.610570:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787841807.610984:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841807.611011:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877472768:0@lo:400: 00000100:00100000:3.0:1787841807.611078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841807.611122:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472768 00000100:00100000:3.0:1787841807.611130:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472768 00000100:00100000:3.0:1787841807.611183:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841807.611192:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877472768:12345-0@lo:400: 00000100:00100000:3.0:1787841807.611241:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877472768:12345-0@lo:400: Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841807.611248:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787841807.611285:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980f480 x1874687877472768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841807.611301:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877472768:0@lo:400: 00000100:00080000:3.0:1787841807.611323:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841807.611705:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841807.611716:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877472640:0@lo:400: 00000100:00100000:0.0:1787841807.611761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841807.613919:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472640 00000100:00100000:3.0:1787841807.613934:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472640 00000100:00100000:3.0:1787841807.614033:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841807.614043:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877472640:12345-0@lo:400: 00000100:00100000:3.0:1787841807.614126:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877472640:12345-0@lo:400: Request processed in 85us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841807.614133:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787841807.614306:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841807.614346:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877472640:0@lo:400: 00000100:00100000:1.0:1787841807.614712:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877472128:0@lo:400: 00010000:00010000:0.0:1787841807.857764:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841808.022350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841808.022554:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576640 00000100:00100000:1.0:1787841808.022565:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576640 00000100:00080000:0.0:1787841808.023532:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841808.026716:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:1.0:1787841808.026747:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:5666:x1874687858576640:12345-192.168.202.46@tcp:41: 00000004:00000024:1.0:1787841808.026806:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787841808.026919:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:5666:x1874687858576640:12345-192.168.202.46@tcp:41: Request processed in 187us (4583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841808.026947:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:2.0:1787841808.035352:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841808.037655:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576768 00000100:00100000:3.0:1787841808.037672:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576768 00000100:00100000:3.0:1787841808.037778:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:3.0:1787841808.037790:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5666:x1874687858576768:12345-192.168.202.46@tcp:13: 00000100:00080000:1.0:1787841808.038149:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787841808.039122:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841808.039223:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5666:x1874687858576768:12345-192.168.202.46@tcp:13: Request processed in 1430us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841808.039242:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:2.0:1787841808.043876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841808.044081:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858576896 00000100:00100000:0.0:1787841808.044094:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858576896 00000100:00100000:0.0:1787841808.044219:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:0.0:1787841808.044229:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5666:x1874687858576896:12345-192.168.202.46@tcp:13: 00002000:00000024:0.0:1787841808.044306:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841808.044394:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:5666:x1874687858576896:12345-192.168.202.46@tcp:13: Request processed in 165us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841808.044402:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00080000:1.0:1787841808.049553:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841808.122294:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841808.122321:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877472896:0@lo:13: 00000100:00100000:0.0:1787841808.122395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841808.122482:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877472896 00000100:00100000:0.0:1787841808.122490:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877472896 00000100:00100000:0.0:1787841808.122536:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787841808.122545:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877472896:12345-0@lo:13: 00002000:00000024:0.0:1787841808.122572:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841808.123545:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877472896:12345-0@lo:13: Request processed in 995us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841808.123555:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787841808.123711:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e8780 x1874687877472896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841808.123734:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877472896:0@lo:13: 00000001:00100000:1.0:1787841808.237787:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000100:00100000:1.0:1787841808.627443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841808.627501:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877473024:0@lo:13: 00000100:00100000:1.0:1787841808.627592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841808.628011:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473024 00000100:00100000:3.0:1787841808.628020:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473024 00000100:00100000:3.0:1787841808.628079:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787841808.628090:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877473024:12345-0@lo:13: 00002000:00000024:3.0:1787841808.628118:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841808.628261:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877473024:12345-0@lo:13: Request processed in 173us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841808.628269:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787841808.635592:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980f480 x1874687877473024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841808.635631:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877473024:0@lo:13: 00000001:00100000:1.0:1787841808.725741:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00010000:00010000:2.0:1787841808.882386:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841809.687672:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00010000:00010000:3.0:1787841809.908280:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841810.716052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841810.716091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841810.716117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841810.716142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841810.716171:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577152 00000100:00100000:2.0:1787841810.716181:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577152 00000100:00100000:2.0:1787841810.716239:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:2.0:1787841810.716250:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858577152:12345-192.168.202.46@tcp:400: 00000100:00100000:2.0:1787841810.716329:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858577152:12345-192.168.202.46@tcp:400: Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841810.716337:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:2.0:1787841810.716358:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577280 00000100:00100000:2.0:1787841810.716361:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577280 00000100:00100000:2.0:1787841810.716383:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577408 00000100:00100000:2.0:1787841810.716385:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577408 00000100:00100000:2.0:1787841810.716398:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787841810.716404:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858577280:12345-192.168.202.46@tcp:400: 00000100:00100000:2.0:1787841810.716427:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858577280:12345-192.168.202.46@tcp:400: Request processed in 24us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841810.716433:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787841810.716442:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:2.0:1787841810.716448:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858577408:12345-192.168.202.46@tcp:400: 00000100:00100000:2.0:1787841810.716489:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858577408:12345-192.168.202.46@tcp:400: Request processed in 41us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841810.716515:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00080000:2.0:1787841810.716532:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841810.716535:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841810.716538:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841810.716924:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577024 00000100:00100000:3.0:1787841810.716930:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577024 00000100:00100000:3.0:1787841810.716977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 130 00000100:00100000:3.0:1787841810.716986:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2349:x1874687858577024:12345-192.168.202.46@tcp:400: 00000100:00100000:3.0:1787841810.717019:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2349:x1874687858577024:12345-192.168.202.46@tcp:400: Request processed in 35us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841810.717025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 130 00000001:02000400:2.0:1787841810.785990:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787841810.930571:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841811.953722:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841812.722660:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877473280:0@lo:400: 00000100:00100000:3.0:1787841812.722757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841812.722808:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877473792:0@lo:400: 00000100:00100000:3.0:1787841812.722834:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841812.722864:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841812.722870:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877473408:0@lo:400: 00000100:00100000:3.0:1787841812.722900:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841812.722930:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473280 00000100:00100000:3.0:1787841812.722938:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473280 00000100:00100000:3.0:1787841812.722981:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473408 00000100:00100000:3.0:1787841812.722984:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473408 00000100:00100000:3.0:1787841812.723009:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787841812.723017:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877473280:12345-0@lo:400: 00000100:00100000:3.0:1787841812.723072:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877473280:12345-0@lo:400: Request processed in 55us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841812.723079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787841812.723098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841812.723105:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877473408:12345-0@lo:400: 00000100:00100000:3.0:1787841812.723130:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877473408:12345-0@lo:400: Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841812.723136:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841812.723172:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877473408:0@lo:400: 00000100:00100000:3.0:1787841812.723183:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877473280:0@lo:400: 00000100:00100000:2.0:1787841812.723796:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877473152:0@lo:400: 00000100:00100000:2.0:1787841812.723835:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841812.723909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473152 00000100:00100000:3.0:1787841812.723913:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473152 00000100:00100000:3.0:1787841812.723944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787841812.723950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877473152:12345-0@lo:400: 00000100:00100000:3.0:1787841812.723995:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877473152:12345-0@lo:400: Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841812.724000:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787841812.724389:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877473152:0@lo:400: 00000100:00100000:2.0:1787841812.724398:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877473664:0@lo:400: 00000100:00100000:2.0:1787841812.724424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841812.727783:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841812.727807:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877473536:0@lo:400: 00000100:00100000:2.0:1787841812.727870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841812.727924:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473792 00000100:00100000:2.0:1787841812.727930:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473792 00000100:00100000:2.0:1787841812.727974:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473536 00000100:00100000:2.0:1787841812.727977:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473536 00000100:00100000:2.0:1787841812.727991:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787841812.727999:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877473792:12345-0@lo:400: 00000100:00100000:2.0:1787841812.728052:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877473792:12345-0@lo:400: Request processed in 54us (5218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841812.728059:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787841812.728073:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787841812.728079:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877473536:12345-0@lo:400: 00000100:00100000:2.0:1787841812.728102:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877473536:12345-0@lo:400: Request processed in 23us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841812.728124:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841812.730126:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473664 00000100:00100000:3.0:1787841812.730144:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473664 00000100:00100000:3.0:1787841812.730218:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787841812.730228:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877473664:12345-0@lo:400: 00000100:00100000:3.0:1787841812.730315:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877473664:12345-0@lo:400: Request processed in 88us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841812.730321:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787841812.731223:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841812.731231:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841812.731235:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787841812.731954:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93e580 x1874687877473792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841812.731973:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877473792:0@lo:400: 00010000:00080000:2.0:1787841812.732013:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980f840 x1874687877473536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841812.732023:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877473536:0@lo:400: 00000100:00100000:2.0:1787841812.732037:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877473664:0@lo:400: 00010000:00010000:0.0:1787841812.980424:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841813.240590:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463823503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877473920:0@lo:13: 00000100:00100000:1.0:1787841813.241191:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841813.241279:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877473920 00000100:00100000:1.0:1787841813.241287:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877473920 00000100:00100000:1.0:1787841813.241334:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841813.241343:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877473920:12345-0@lo:13: 00002000:00000024:1.0:1787841813.241396:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841813.241442:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877473920:12345-0@lo:13: Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841813.241449:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787841813.241508:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9463823503c0 x1874687877473920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841813.241526:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463823503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877473920:0@lo:13: 00000100:00100000:2.0:1787841813.754249:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463823503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877474048:0@lo:13: 00000100:00100000:2.0:1787841813.754342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841813.754437:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877474048 00000100:00100000:2.0:1787841813.754445:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877474048 00000100:00100000:2.0:1787841813.754522:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841813.754531:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877474048:12345-0@lo:13: 00002000:00000024:2.0:1787841813.754578:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841813.754629:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877474048:12345-0@lo:13: Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841813.754636:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787841813.754683:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9463823503c0 x1874687877474048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841813.754703:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463823503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877474048:0@lo:13: 00010000:00010000:3.0:1787841814.002244:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787841814.477144:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6298c4b0 20000000:00000080:3.0:1787841814.477165:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464b9e38400 uarg=0000000000000000 20000000:01000000:3.0:1787841814.477216:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787841814.477219:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787841814.477222:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787841814.477227:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787841814.477233:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787841814.477249:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787841814.477252:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787841814.477530:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787841814.477534:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787841814.479308:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787841814.480261:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787841814.480326:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787841814.480361:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787841814.480373:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787841814.480375:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787841814.482254:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787841814.483422:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787841814.483613:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787841814.483824:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787841814.483842:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787841814.483845:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787841814.484907:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787841814.485895:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787841814.486027:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787841814.486079:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787841814.486096:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787841814.486099:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787841814.487366:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787841814.488274:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787841814.488352:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787841814.488393:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787841814.488409:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787841814.488435:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488610:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488619:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488626:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488632:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488638:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488710:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488784:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488794:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488812:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488820:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488866:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.488883:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 9 pid: 5842 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.488900:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474176:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841814.489147:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489156:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 9 pid: 5841 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489165:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841814.489213:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489221:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 18 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489230:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474432:0@lo:104: 00000100:00100000:3.0:1787841814.489275:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841814.489328:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489336:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 18 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489344:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474560:0@lo:104: 00000100:00100000:3.0:1787841814.489372:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841814.489406:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489414:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 18 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489422:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474688:0@lo:104: 00010000:00010000:3.0:1787841814.489444:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489451:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 18 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489490:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474816:0@lo:104: 00010000:00010000:3.0:1787841814.489519:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489527:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 18 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489534:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474944:0@lo:104: 00010000:00010000:3.0:1787841814.489551:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489577:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 18 pid: 5841 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489585:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877475072:0@lo:104: 00010000:00010000:3.0:1787841814.489614:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.489622:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 18 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.489628:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877475200:0@lo:104: 00000100:00100000:3.0:1787841814.489655:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841814.489743:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787841814.489762:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.489775:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.489783:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.489791:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.489799:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.489806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877474432 00000100:00100000:1.0:1787841814.489813:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877474432 00000100:00100000:1.0:1787841814.489849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877474560 00000100:00100000:1.0:1787841814.489851:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877474560 00000100:00100000:1.0:1787841814.489859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877474688 00000100:00100000:1.0:1787841814.489861:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877474688 00000100:00100000:1.0:1787841814.489868:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877474816 00000100:00100000:1.0:1787841814.489870:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877474816 00000100:00100000:1.0:1787841814.489877:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877474944 00000100:00100000:1.0:1787841814.489880:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877474944 00000100:00100000:1.0:1787841814.489887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475072 00000100:00100000:1.0:1787841814.489889:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475072 00000100:00100000:1.0:1787841814.489898:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475200 00000100:00100000:1.0:1787841814.489900:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475200 00000100:00100000:1.0:1787841814.489913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841814.489921:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+9:8445:x1874687877474432:12345-0@lo:104: 00010000:00010000:1.0:1787841814.489948:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490007:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841814.490013:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+9:8445:x1874687877474432:12345-0@lo:104: Request processed in 93us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490020:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841814.490037:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841814.490050:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a721a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+8:8445:x1874687877474560:12345-0@lo:104: 00010000:00010000:1.0:1787841814.490058:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490088:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787841814.490093:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a721a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+8:8445:x1874687877474560:12345-0@lo:104: Request processed in 44us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841814.490134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841814.490139:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+7:8445:x1874687877474688:12345-0@lo:104: 00010000:00010000:1.0:1787841814.490146:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490172:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787841814.490176:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+7:8445:x1874687877474688:12345-0@lo:104: Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841814.490191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841814.490195:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+6:8445:x1874687877474816:12345-0@lo:104: 00010000:00010000:1.0:1787841814.490202:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490229:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787841814.490233:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+6:8445:x1874687877474816:12345-0@lo:104: Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841814.490249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841814.490261:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+5:8445:x1874687877474944:12345-0@lo:104: 00010000:00010000:1.0:1787841814.490269:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490294:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787841814.490298:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+5:8445:x1874687877474944:12345-0@lo:104: Request processed in 39us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490304:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841814.490315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841814.490321:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:8445:x1874687877475072:12345-0@lo:104: 00010000:00010000:1.0:1787841814.490329:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490353:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787841814.490358:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:8445:x1874687877475072:12345-0@lo:104: Request processed in 38us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490363:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841814.490373:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787841814.490379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:8445:x1874687877475200:12345-0@lo:104: 00010000:00010000:1.0:1787841814.490386:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490409:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787841814.490414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:8445:x1874687877475200:12345-0@lo:104: Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.490419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787841814.490438:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787841814.490450:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490483:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490488:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490496:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.490503:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.490509:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.490541:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490548:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.490586:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490592:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480e00/0x1d0ed3605e135e5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490608:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787841814.490611:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490616:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490618:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490635:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.490641:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.490645:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.490659:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490665:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.490678:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490684:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e135e32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e39 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490694:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787841814.490697:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490702:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490705:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490711:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.490716:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.490727:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.490741:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490747:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.490752:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490758:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135e16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490768:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787841814.490771:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490777:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481800 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490780:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490786:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.490792:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.490797:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.490807:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490813:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.490825:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490831:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485481800/0x1d0ed3605e135e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e0f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490840:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787841814.490843:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490849:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dca00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490851:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490857:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.490863:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.490868:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.490880:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490885:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.490889:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490894:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dca00/0x1d0ed3605e135dfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135e01 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490904:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787841814.490912:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490917:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490919:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490925:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.490931:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.490935:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.490960:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490966:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.490970:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490976:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480800/0x1d0ed3605e135dd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dd7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490984:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841814.490987:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.490992:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787841814.490995:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491013:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841814.491019:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841814.491024:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841814.491035:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491041:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841814.491045:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491051:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135da6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dad expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491063:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841814.491065:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841814.491067:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841814.491076:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841814.491083:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841814.491088:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841814.491101:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877475456:0@lo:103: 00000100:00100000:1.0:1787841814.491138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.491160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877475968:0@lo:103: 00000100:00100000:1.0:1787841814.491174:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.491189:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787841814.491194:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877475584:0@lo:103: 00000100:00100000:1.0:1787841814.491215:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.491229:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877476096:0@lo:103: 00000100:00100000:1.0:1787841814.491244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.491267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475456 00000100:00100000:1.0:1787841814.491273:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475456 00010000:00010000:1.0:1787841814.491296:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 19 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.491313:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475968 00000100:00100000:1.0:1787841814.491315:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475968 00010000:00010000:1.0:1787841814.491323:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 20 pid: 5841 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.491331:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475584 00000100:00100000:1.0:1787841814.491333:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475584 00010000:00010000:1.0:1787841814.491341:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 21 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.491348:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476096 00000100:00100000:1.0:1787841814.491350:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476096 00010000:00010000:1.0:1787841814.491359:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 22 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.491371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841814.491377:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+22:3308:x1874687877475456:12345-0@lo:103: 00010000:00010000:1.0:1787841814.491387:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841814.491392:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 22 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491401:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 22 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491421:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841814.491446:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+22:3308:x1874687877475456:12345-0@lo:103: Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.491452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841814.491490:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841814.491496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+21:3308:x1874687877475968:12345-0@lo:103: 00010000:00010000:1.0:1787841814.491504:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841814.491507:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 21 pid: 5841 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491516:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 21 pid: 5841 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491524:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841814.491542:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+21:3308:x1874687877475968:12345-0@lo:103: Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.491547:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841814.491557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841814.491575:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+20:3308:x1874687877475584:12345-0@lo:103: 00010000:00010000:1.0:1787841814.491582:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841814.491587:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 20 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491595:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 20 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491604:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841814.491629:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+20:3308:x1874687877475584:12345-0@lo:103: Request processed in 66us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.491635:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841814.491646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841814.491651:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877476096:12345-0@lo:103: 00010000:00010000:1.0:1787841814.491660:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841814.491663:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 19 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491671:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 19 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.491679:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841814.491695:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877476096:12345-0@lo:103: Request processed in 45us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.491700:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841814.491735:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877475584:0@lo:103: 00000100:00100000:1.0:1787841814.491743:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877476096:0@lo:103: 00000100:00100000:1.0:1787841814.491749:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877475456:0@lo:103: 00000100:00100000:1.0:1787841814.491754:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877475968:0@lo:103: 00000100:00100000:3.0:1787841814.492086:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474432:0@lo:104: 00010000:00010000:3.0:1787841814.492098:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dd800/0x1d0ed3605e135e39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135e32 expref: 18 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.492110:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474560:0@lo:104: 00010000:00010000:3.0:1787841814.492119:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e135e1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135e16 expref: 17 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.492128:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474688:0@lo:104: 00000100:00100000:3.0:1787841814.492137:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474816:0@lo:104: 00000100:00100000:3.0:1787841814.492146:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474944:0@lo:104: 00010000:00010000:3.0:1787841814.492154:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dde00/0x1d0ed3605e135dd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135dd0 expref: 16 pid: 5841 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.492161:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877475072:0@lo:104: 00010000:00010000:3.0:1787841814.492183:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dd600/0x1d0ed3605e135dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135da6 expref: 15 pid: 5842 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.492191:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877475200:0@lo:104: 00000100:00100000:3.0:1787841814.492953:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382351680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877475712:0@lo:103: 00000100:00100000:3.0:1787841814.493011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841814.493065:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787841814.493072:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877475328:0@lo:103: 00000100:00100000:3.0:1787841814.493093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841814.493183:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877475840:0@lo:103: 00000100:00100000:3.0:1787841814.493206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841814.494017:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475712 00000100:00100000:0.0:1787841814.494026:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475712 00010000:00010000:0.0:1787841814.494066:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 15 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.494094:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475328 00000100:00100000:0.0:1787841814.494097:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475328 00010000:00010000:0.0:1787841814.494108:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 16 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.494118:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877475840 00000100:00100000:0.0:1787841814.494133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877475840 00010000:00010000:0.0:1787841814.494147:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 17 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.494163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787841814.494185:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+17:3306:x1874687877475712:12345-0@lo:103: 00010000:00010000:0.0:1787841814.494199:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841814.494205:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 17 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494216:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 17 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494235:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481498c00/0x1d0ed3605e135e0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135e08 expref: 17 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494253:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841814.494305:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+16:3306:x1874687877475712:12345-0@lo:103: Request processed in 134us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841814.494313:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787841814.494331:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787841814.494337:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+15:3306:x1874687877475328:12345-0@lo:103: 00010000:00010000:0.0:1787841814.494345:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841814.494349:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 15 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494357:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 15 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494367:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc000/0x1d0ed3605e135e63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135e5c expref: 15 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494385:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841814.494409:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+14:3306:x1874687877475328:12345-0@lo:103: Request processed in 72us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841814.494415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787841814.494428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787841814.494435:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648709cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+13:3306:x1874687877475840:12345-0@lo:103: 00010000:00010000:0.0:1787841814.494442:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841814.494446:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 13 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494478:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 13 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494489:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480c00/0x1d0ed3605e135e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135dfa expref: 13 pid: 5844 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.494498:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841814.494518:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648709cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+12:3306:x1874687877475840:12345-0@lo:103: Request processed in 85us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841814.494524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787841814.494707:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877475328:0@lo:103: 00000100:00100000:3.0:1787841814.494718:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877475840:0@lo:103: 00000100:00100000:3.0:1787841814.494725:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382351680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877475712:0@lo:103: 00000100:00100000:2.0:1787841814.498418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841814.498506:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841814.498542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577536 00000100:00100000:2.0:1787841814.498578:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577536 00010000:00010000:2.0:1787841814.498624:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 10 pid: 5842 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841814.498673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577664 00000100:00100000:2.0:1787841814.498677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577664 00010000:00010000:2.0:1787841814.498692:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 11 pid: 5841 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841814.498709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:2.0:1787841814.498719:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2349:x1874687858577536:12345-192.168.202.46@tcp:103: 00010000:00010000:2.0:1787841814.498737:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841814.498744:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 11 pid: 5842 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498759:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 11 pid: 5842 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498784:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841814.498840:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2349:x1874687858577536:12345-192.168.202.46@tcp:103: Request processed in 122us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.498847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:2.0:1787841814.498867:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:2.0:1787841814.498874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2349:x1874687858577664:12345-192.168.202.46@tcp:103: 00010000:00010000:2.0:1787841814.498882:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841814.498887:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 10 pid: 5841 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498896:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 10 pid: 5841 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498919:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498942:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498960:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498967:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498976:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498983:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.498990:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841814.498994:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.499004:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.499014:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.499025:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841814.499046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2349:x1874687858577664:12345-192.168.202.46@tcp:103: Request processed in 173us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.499061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00010000:00010000:3.0:1787841814.500095:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481400/0x1d0ed3605e135e78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9792d expref: 9 pid: 5842 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.500117:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474176:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841814.500131:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc600/0x1d0ed3605e135e71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97926 expref: 8 pid: 5841 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.500142:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687877474304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841814.500253:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.500279:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.500285:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.500290:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030a00/0x1d0ed3605e135eb0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.025726:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841815.822150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841815.822203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841815.822242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841815.822272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841815.822310:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578176 00000100:00100000:2.0:1787841815.822320:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578176 00000100:00100000:2.0:1787841815.822383:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578048 00000100:00100000:2.0:1787841815.822387:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578048 00000100:00100000:2.0:1787841815.822418:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:2.0:1787841815.822431:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858578176:12345-192.168.202.46@tcp:400: 00000100:00100000:2.0:1787841815.822543:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858578176:12345-192.168.202.46@tcp:400: Request processed in 115us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.822561:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:2.0:1787841815.822579:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:2.0:1787841815.822586:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858578048:12345-192.168.202.46@tcp:400: 00000100:00100000:2.0:1787841815.822608:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858578048:12345-192.168.202.46@tcp:400: Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.822614:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00080000:2.0:1787841815.822628:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841815.822632:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841815.822932:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577792 00000100:00100000:1.0:1787841815.822937:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577792 00000100:00100000:1.0:1787841815.822977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 132 00000100:00100000:1.0:1787841815.822985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:2346:x1874687858577792:12345-192.168.202.46@tcp:400: 00000100:00100000:1.0:1787841815.823020:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:2346:x1874687858577792:12345-192.168.202.46@tcp:400: Request processed in 36us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841815.823043:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 132 00000100:00100000:3.0:1787841815.823339:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858577920 00000100:00100000:3.0:1787841815.823345:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858577920 00000100:00080000:0.0:1787841815.823392:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841815.823399:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:3.0:1787841815.823408:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858577920:12345-192.168.202.46@tcp:400: 00000100:00100000:3.0:1787841815.823454:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858577920:12345-192.168.202.46@tcp:400: Request processed in 47us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841815.823487:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 27 10000000:01000000:3.0:1787841815.985632:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787841815.985650:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9464c1af7000 from 39 10000000:01000000:3.0:1787841815.985657:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787841815.985719:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.985732:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.985746:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841815.985907:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476224:0@lo:101: 00000100:00100000:3.0:1787841815.986018:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841815.986164:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787841815.995386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476224 00000100:00100000:0.0:1787841815.995417:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476224 00000100:00100000:0.0:1787841815.995519:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787841815.995531:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+12:5847:x1874687877476224:12345-0@lo:101: 00010000:00010000:0.0:1787841815.995563:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841815.995589:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480c00/0x1d0ed3605e135ebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135eb7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841815.995653:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480c00/0x1d0ed3605e135ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135eb7 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841815.995666:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480c00/0x1d0ed3605e135ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135eb7 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841815.995677:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480c00, rc 0) 00000100:00100000:1.0:1787841815.996050:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476224:0@lo:101: 00010000:00010000:1.0:1787841815.996076:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.996089:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841815.996188:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476352:0@lo:501: 00000100:00100000:1.0:1787841815.996233:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841815.996279:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841815.996390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476352 00000100:00100000:2.0:1787841815.996396:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476352 00000100:00100000:2.0:1787841815.996444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787841815.996453:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476352:12345-0@lo:501: 00000100:00100000:2.0:1787841815.996763:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476352:12345-0@lo:501: Request processed in 311us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.996779:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787841815.997005:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476352:0@lo:501: 00000100:00100000:1.0:1787841815.997042:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476480:0@lo:503: 00000100:00100000:1.0:1787841815.997081:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841815.997120:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841815.997285:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476480 00000100:00100000:2.0:1787841815.997290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476480 00000100:00100000:2.0:1787841815.997323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787841815.997330:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476480:12345-0@lo:503: 00000100:00100000:2.0:1787841815.997505:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476480:12345-0@lo:503: Request processed in 175us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.997511:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787841815.997732:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:5847:x1874687877476224:12345-0@lo:101: Request processed in 2201us (11712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841815.997740:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787841815.998256:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476480:0@lo:503: 00000100:00100000:3.0:1787841816.003954:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8463:1874687877476608:0@lo:502: 00000100:00100000:3.0:1787841816.004059:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841816.004112:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.004241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476608 00000100:00100000:2.0:1787841816.004249:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476608 00000100:00100000:2.0:1787841816.004303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787841816.004312:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:8463:x1874687877476608:12345-0@lo:502: 00000100:00100000:2.0:1787841816.004652:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+13:8463:x1874687877476608:12345-0@lo:502: Request processed in 340us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.004661:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787841816.004847:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8463:1874687877476608:0@lo:502: 00000100:00100000:3.0:1787841816.004903:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8463:1874687877476736:0@lo:502: 00000100:00100000:3.0:1787841816.004937:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841816.004966:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.005068:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476736 00000100:00100000:2.0:1787841816.005073:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476736 00000100:00100000:2.0:1787841816.005108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787841816.005116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:8463:x1874687877476736:12345-0@lo:502: 00000100:00100000:2.0:1787841816.005254:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+13:8463:x1874687877476736:12345-0@lo:502: Request processed in 138us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.005260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787841816.005534:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8463:1874687877476736:0@lo:502: 00000040:00080000:3.0:1787841816.005567:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787841816.005910:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787841816.005932:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841816.005945:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.005967:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841816.005980:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787841816.005983:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787841816.005995:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787841816.006025:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.006033:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.006042:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.006055:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476864:0@lo:101: 00000100:00100000:1.0:1787841816.006091:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.006124:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841816.006280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476864 00000100:00100000:0.0:1787841816.006286:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476864 00000100:00100000:0.0:1787841816.006326:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787841816.006335:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+13:5847:x1874687877476864:12345-0@lo:101: 00010000:00010000:0.0:1787841816.006345:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.006360:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481400/0x1d0ed3605e135ecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135ec5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.006386:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481400/0x1d0ed3605e135ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135ec5 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.006397:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481400/0x1d0ed3605e135ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135ec5 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.006622:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481400, rc 0) 00000100:00100000:0.0:1787841816.006667:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476864:12345-0@lo:101: Request processed in 333us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.006674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787841816.007606:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476864:0@lo:101: 00010000:00010000:1.0:1787841816.007627:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.007636:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.007688:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476992:0@lo:501: 00000100:00100000:1.0:1787841816.007723:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.007797:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.015212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877476992 00000100:00100000:3.0:1787841816.015230:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877476992 00000100:00100000:2.0:1787841816.016223:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787841816.016238:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476992:12345-0@lo:501: 00000100:00100000:2.0:1787841816.016636:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877476992:12345-0@lo:501: Request processed in 401us (8912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.016654:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787841816.016838:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877476992:0@lo:501: 00000100:00100000:1.0:1787841816.016909:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477120:0@lo:503: 00000100:00100000:1.0:1787841816.016954:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.016990:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.018116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477120 00000100:00100000:2.0:1787841816.018128:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477120 00000100:00100000:2.0:1787841816.018192:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787841816.018201:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877477120:12345-0@lo:503: 00000100:00100000:2.0:1787841816.019335:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877477120:12345-0@lo:503: Request processed in 1127us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.019348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787841816.024850:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477120:0@lo:503: 00000100:00100000:3.0:1787841816.025523:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8464:1874687877477248:0@lo:502: 00000100:00100000:3.0:1787841816.025638:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841816.025679:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787841816.025792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477248 00000100:00100000:0.0:1787841816.025800:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477248 00000100:00100000:0.0:1787841816.025854:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787841816.025865:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:8464:x1874687877477248:12345-0@lo:502: 00000100:00100000:0.0:1787841816.026150:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+14:8464:x1874687877477248:12345-0@lo:502: Request processed in 286us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.026158:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787841816.026400:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8464:1874687877477248:0@lo:502: 00000020:01000000:3.0:1787841816.026438:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841816.026448:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841816.026451:0:8464:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787841816.026522:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787841816.026560:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8464:1874687877477376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841816.026596:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841816.026630:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.026784:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477376 00000100:00100000:2.0:1787841816.026789:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477376 00000100:00100000:2.0:1787841816.026826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787841816.026835:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:8464:x1874687877477376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841816.027148:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+14:8464:x1874687877477376:12345-0@lo:502:llog_process_th.0 Request processed in 313us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.027156:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787841816.027608:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8464:1874687877477376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787841816.027633:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841816.027645:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841816.027648:0:8464:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787841816.027653:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787841816.027837:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787841816.027859:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787841816.027870:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.027893:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841816.027903:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787841816.027906:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946486706000 from 39 10000000:01000000:1.0:1787841816.027909:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841816.027937:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.027945:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.027953:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.028092:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.028135:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.028175:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.028241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477504 00000100:00100000:2.0:1787841816.028247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477504 00000100:00100000:2.0:1787841816.028290:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787841816.028299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+14:5847:x1874687877477504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841816.028311:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.028326:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2045400/0x1d0ed3605e135eda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135ed3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.028352:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2045400/0x1d0ed3605e135eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135ed3 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.028365:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2045400/0x1d0ed3605e135eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135ed3 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.028385:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2045400, rc 0) 00000100:00100000:2.0:1787841816.028676:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877477504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 378us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.028683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787841816.028756:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841816.028770:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.028780:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.028845:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.028872:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.028907:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.029063:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477632 00000100:00100000:2.0:1787841816.029068:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477632 00000100:00100000:2.0:1787841816.029100:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787841816.029106:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877477632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.029360:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877477632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.029367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787841816.029827:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.029866:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.029921:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.030603:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.030714:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477760 00000100:00100000:2.0:1787841816.030721:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477760 00000100:00100000:2.0:1787841816.030772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787841816.030781:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877477760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.031139:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877477760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.031148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787841816.037241:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877477760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841816.037926:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8465:1874687877477888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841816.038248:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841816.038290:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841816.038351:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877477888 00000100:00100000:0.0:1787841816.038358:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877477888 00000100:00100000:0.0:1787841816.038899:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787841816.038914:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+15:8465:x1874687877477888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841816.039570:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+15:8465:x1874687877477888:12345-0@lo:502:llog_process_th.0 Request processed in 657us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.039580:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787841816.039757:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8465:1874687877477888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841816.039823:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8465:1874687877478016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841816.039859:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841816.039898:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.040318:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478016 00000100:00100000:1.0:1787841816.040324:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478016 00000100:00100000:1.0:1787841816.040369:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787841816.040377:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:8465:x1874687877478016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841816.040734:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+15:8465:x1874687877478016:12345-0@lo:502:llog_process_th.0 Request processed in 356us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.040741:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00010000:1.0:1787841816.050087:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841816.050277:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8465:1874687877478016:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787841816.050344:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787841816.050658:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787841816.050684:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841816.050696:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.050710:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841816.050750:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787841816.050753:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787841816.050756:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787841816.050798:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.050807:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.050818:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.050840:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.050915:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.050972:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.052408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478144 00000100:00100000:2.0:1787841816.052423:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478144 00000100:00100000:2.0:1787841816.053098:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787841816.053113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+15:5847:x1874687877478144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841816.053155:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.053178:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2044600/0x1d0ed3605e135ee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135ee1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.053211:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2044600/0x1d0ed3605e135ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135ee1 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.053223:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2044600/0x1d0ed3605e135ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135ee1 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.053234:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044600, rc 0) 00000100:00100000:2.0:1787841816.053332:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877478144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.053338:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787841816.056198:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841816.056240:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.056253:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841816.056354:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.056419:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841816.056493:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.056721:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478272 00000100:00100000:1.0:1787841816.056730:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478272 00000100:00100000:1.0:1787841816.056785:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787841816.056796:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877478272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.057206:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877478272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.057213:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787841816.061848:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.061930:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.062033:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.062071:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.062435:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478400 00000100:00100000:1.0:1787841816.062445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478400 00000100:00100000:1.0:1787841816.062522:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787841816.062530:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877478400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.062777:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877478400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.062792:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787841816.063100:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.064300:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8466:1874687877478528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841816.064368:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.064424:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.064682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478528 00000100:00100000:1.0:1787841816.064688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478528 00000100:00100000:1.0:1787841816.064743:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787841816.064752:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:8466:x1874687877478528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841816.065270:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:8466:x1874687877478528:12345-0@lo:502:llog_process_th.0 Request processed in 517us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.065280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787841816.065387:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8466:1874687877478528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841816.065429:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841816.065440:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841816.065442:0:8466:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787841816.065447:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787841816.065515:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8466:1874687877478656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841816.065569:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.065596:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.065921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478656 00000100:00100000:2.0:1787841816.065928:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478656 00000100:00100000:2.0:1787841816.065976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787841816.065984:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:8466:x1874687877478656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841816.066159:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+16:8466:x1874687877478656:12345-0@lo:502:llog_process_th.0 Request processed in 176us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.066166:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787841816.066874:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8466:1874687877478656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841816.066907:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841816.066915:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841816.066917:0:8466:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787841816.066922:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787841816.067164:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787841816.067188:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787841816.067203:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.067215:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841816.067226:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787841816.067230:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946485cca000 from 39 10000000:01000000:1.0:1787841816.067233:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841816.067267:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.067275:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.067287:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.067306:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.067369:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.067421:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.067557:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478784 00000100:00100000:2.0:1787841816.067563:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478784 00000100:00100000:2.0:1787841816.067606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787841816.067616:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877478784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841816.067629:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.067643:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135eef expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.067670:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135eef expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.067683:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135eef expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.067704:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044c00, rc 0) 00000100:00100000:2.0:1787841816.067744:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877478784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.067751:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787841816.067940:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841816.068037:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.068049:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.068102:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.068129:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.068160:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.068211:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877478912 00000100:00100000:3.0:1787841816.068216:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877478912 00000100:00100000:3.0:1787841816.068248:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787841816.068256:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877478912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841816.068593:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877478912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.068602:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787841816.068807:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877478912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.068838:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.068877:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.068902:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.068975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479040 00000100:00100000:1.0:1787841816.068981:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479040 00000100:00100000:1.0:1787841816.069016:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787841816.069024:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877479040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.069175:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877479040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.069182:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787841816.070510:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.071512:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8467:1874687877479168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841816.071612:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.071658:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.071897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479168 00000100:00100000:1.0:1787841816.071904:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479168 00000100:00100000:1.0:1787841816.071955:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787841816.071974:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:8467:x1874687877479168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841816.072597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:8467:x1874687877479168:12345-0@lo:502:llog_process_th.0 Request processed in 622us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.072606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787841816.073229:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8467:1874687877479168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841816.073302:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8467:1874687877479296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841816.073349:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.073387:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.073524:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479296 00000100:00100000:2.0:1787841816.073530:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479296 00000100:00100000:2.0:1787841816.073582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787841816.073592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:8467:x1874687877479296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841816.073826:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:8467:x1874687877479296:12345-0@lo:502:llog_process_th.0 Request processed in 235us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.073843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787841816.074341:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8467:1874687877479296:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787841816.074368:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787841816.075110:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787841816.075131:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787841816.075143:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.075155:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841816.075165:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787841816.075168:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787841816.075171:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787841816.075207:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.075215:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.075227:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841816.075248:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.075294:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841816.075326:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.075504:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479424 00000100:00100000:3.0:1787841816.075510:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479424 00000100:00100000:3.0:1787841816.075564:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787841816.075572:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877479424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841816.075586:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841816.075600:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480031a00/0x1d0ed3605e135f04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135efd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.075642:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480031a00/0x1d0ed3605e135f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135efd expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.075654:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480031a00/0x1d0ed3605e135f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135efd expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.075664:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031a00, rc 0) 00000100:00100000:3.0:1787841816.075717:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877479424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.075724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787841816.075868:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841816.075882:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.075891:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.075943:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.075983:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.076014:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.076263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479552 00000100:00100000:2.0:1787841816.076268:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479552 00000100:00100000:2.0:1787841816.076293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787841816.076300:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877479552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.076632:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877479552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.076644:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787841816.076728:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.076765:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841816.076805:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.076834:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.077372:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479680 00000100:00100000:3.0:1787841816.077380:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479680 00000100:00100000:3.0:1787841816.077424:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787841816.077433:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877479680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841816.077672:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877479680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.077680:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787841816.078015:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877479680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.078685:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8468:1874687877479808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841816.078746:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841816.078785:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.078896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479808 00000100:00100000:3.0:1787841816.078902:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479808 00000100:00100000:3.0:1787841816.078944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787841816.078953:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:8468:x1874687877479808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841816.079194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:8468:x1874687877479808:12345-0@lo:502:llog_process_th.0 Request processed in 243us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.079201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787841816.079500:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8468:1874687877479808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841816.079554:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841816.079565:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841816.079568:0:8468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787841816.079573:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787841816.079598:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8468:1874687877479936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841816.079638:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.079663:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.079923:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877479936 00000100:00100000:3.0:1787841816.079930:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877479936 00000100:00100000:3.0:1787841816.080085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787841816.080094:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:8468:x1874687877479936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841816.080285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:8468:x1874687877479936:12345-0@lo:502:llog_process_th.0 Request processed in 192us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.080293:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787841816.080584:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8468:1874687877479936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841816.080608:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841816.080614:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841816.080616:0:8468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787841816.080620:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787841816.080788:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787841816.080810:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787841816.080821:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.080833:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841816.080843:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787841816.080846:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9464871a4ed8 from 1 10000000:01000000:1.0:1787841816.080849:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787841816.080883:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.080891:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.080901:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.080918:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877480064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.080955:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.081337:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.081404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480064 00000100:00100000:2.0:1787841816.081421:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480064 00000100:00100000:2.0:1787841816.081495:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787841816.081504:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877480064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841816.081517:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.081531:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2044200/0x1d0ed3605e135f12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135f0b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.081567:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2044200/0x1d0ed3605e135f12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135f0b expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.081578:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2044200/0x1d0ed3605e135f12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f0b expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.081587:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044200, rc 0) 00000100:00100000:2.0:1787841816.081623:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877480064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.081629:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787841816.081942:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877480064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841816.081972:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.081982:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.082060:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877480192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841816.082089:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841816.082123:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.082294:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480192 00000100:00100000:2.0:1787841816.082300:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480192 00000100:00100000:2.0:1787841816.082335:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787841816.082342:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877480192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841816.082654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877480192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (562us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787841816.082668:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787841816.082934:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877480192:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787841816.083103:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787841816.083112:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.083121:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.073866:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841817.842016:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877480576:0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.842102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841817.842196:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841817.842203:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877480704:0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.842230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841817.842491:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480576 00000100:00100000:0.0:1787841817.842500:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480576 00000100:00100000:0.0:1787841817.842569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841817.842579:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877480576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841817.842635:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877480576:12345-0@lo:400:kworker.0 Request processed in 59us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841817.842641:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787841817.842710:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877480448:0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.842740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841817.842769:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877480960:0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.842792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841817.842818:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787841817.842824:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877480320:0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.842853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841817.842875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877480832:0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.842900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841817.842925:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480704 00000100:00100000:2.0:1787841817.842929:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480704 00000100:00100000:2.0:1787841817.842968:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480960 00000100:00100000:2.0:1787841817.842972:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480960 00000100:00100000:2.0:1787841817.842987:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841817.842994:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.843026:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877480704:12345-0@lo:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841817.843033:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841817.843045:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841817.843051:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877480960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.843082:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877480960:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841817.843087:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787841817.843124:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946493290b40 x1874687877480960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841817.843230:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877480960:0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.843260:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480320 00000100:00100000:2.0:1787841817.843263:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480320 00000100:00100000:2.0:1787841817.843292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787841817.843299:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877480320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841817.843335:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877480320:12345-0@lo:400:kworker.0 Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841817.843341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787841817.843365:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877480320:0@lo:400:kworker.0 00000100:00080000:1.0:1787841817.843493:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841817.843499:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841817.843501:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841817.843512:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480448 00000100:00100000:1.0:1787841817.843516:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480448 00000100:00100000:1.0:1787841817.843549:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877480832 00000100:00100000:1.0:1787841817.843553:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877480832 00000100:00100000:1.0:1787841817.843577:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787841817.843584:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877480448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.843625:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877480448:12345-0@lo:400:kworker.0 Request processed in 41us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841817.843631:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787841817.843644:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787841817.843650:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877480832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.843676:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877480832:12345-0@lo:400:kworker.0 Request processed in 27us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841817.843683:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787841817.843706:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841817.843726:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648c910f00 x1874687877480704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841817.843736:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877480704:0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.843747:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877480576:0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.843776:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877480832:0@lo:400:kworker.0 00000100:00100000:1.0:1787841817.843785:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877480448:0@lo:400:kworker.0 00010000:00010000:1.0:1787841818.098557:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841818.356093:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841818.356180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841818.356355:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481088 00000100:00100000:0.0:1787841818.356363:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481088 00000100:00100000:0.0:1787841818.356423:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787841818.356432:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877481088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841818.356494:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841818.356550:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877481088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841818.356557:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787841818.357532:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2f0c0 x1874687877481088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841818.357555:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841818.866477:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841818.866506:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877481216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841818.866661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841818.866796:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481216 00000100:00100000:1.0:1787841818.866804:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481216 00000100:00100000:1.0:1787841818.866864:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841818.866874:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877481216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841818.866914:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841818.866963:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877481216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841818.866970:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787841818.867118:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2d2c0 x1874687877481216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841818.867271:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877481216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841818.897446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841818.902153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578304 00000100:00100000:1.0:1787841818.902174:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578304 00000100:00100000:1.0:1787841818.902262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 166 00000100:00100000:1.0:1787841818.902273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:5589:x1874687858578304:12345-192.168.202.46@tcp:101: 00010000:00010000:1.0:1787841818.902537:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841818.902621:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481499600/0x1d0ed3605e135f19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d9798f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.902660:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481499600/0x1d0ed3605e135f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9798f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.902691:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481499600/0x1d0ed3605e135f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9798f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.902703:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499600, rc 0) 00000100:00100000:1.0:1787841818.902841:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858578304:12345-192.168.202.46@tcp:101: Request processed in 568us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841818.902848:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 166 00000100:00100000:0.0:1787841818.907607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841818.907865:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578432 00000100:00100000:2.0:1787841818.907877:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578432 00000100:00100000:2.0:1787841818.907944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 167 00000100:00100000:2.0:1787841818.907954:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858578432:12345-192.168.202.46@tcp:501: 00000100:00100000:2.0:1787841818.908347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858578432:12345-192.168.202.46@tcp:501: Request processed in 392us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841818.908356:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 167 00000100:00100000:2.0:1787841818.912691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841818.912963:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578560 00000100:00100000:1.0:1787841818.912976:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578560 00000100:00100000:1.0:1787841818.913043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 168 00000100:00100000:1.0:1787841818.913055:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858578560:12345-192.168.202.46@tcp:503: 00000100:00100000:2.0:1787841818.919435:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858578560:12345-192.168.202.46@tcp:503: Request processed in 6367us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841818.919449:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 168 00000100:00100000:0.0:1787841818.926691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841818.926790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578688 00000100:00100000:3.0:1787841818.926801:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578688 00000100:00100000:3.0:1787841818.926873:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 169 00000100:00100000:3.0:1787841818.926885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:6073:x1874687858578688:12345-192.168.202.46@tcp:502: 00000100:00100000:3.0:1787841818.927213:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:6073:x1874687858578688:12345-192.168.202.46@tcp:502: Request processed in 331us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841818.927222:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 169 00000100:00100000:0.0:1787841818.936968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841818.937180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578816 00000100:00100000:2.0:1787841818.937192:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578816 00000100:00100000:2.0:1787841818.937261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 170 00000100:00100000:2.0:1787841818.937273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:6073:x1874687858578816:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841818.938037:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:6073:x1874687858578816:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 764us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841818.938047:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 170 00000100:00100000:2.0:1787841818.955384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841818.955512:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858578944 00000100:00100000:0.0:1787841818.955531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858578944 00000100:00100000:0.0:1787841818.955660:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 171 00000100:00100000:0.0:1787841818.955671:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858578944:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841818.955693:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841818.955715:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481e00/0x1d0ed3605e135f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97996 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.955861:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481e00/0x1d0ed3605e135f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97996 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.955877:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481e00/0x1d0ed3605e135f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97996 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.955890:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481e00, rc 0) 00000100:00100000:0.0:1787841818.955999:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858578944:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 329us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841818.956007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 171 00000100:00100000:0.0:1787841818.965902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841818.971901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579072 00000100:00100000:2.0:1787841818.971922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579072 00000100:00100000:2.0:1787841818.972083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 172 00000100:00100000:2.0:1787841818.972096:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579072:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841818.972483:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579072:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 389us (6594us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787841818.972492:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 172 00010000:00010000:1.0:1787841819.125582:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841820.155885:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787841820.228384:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc90ffe170 20000000:00000080:2.0:1787841820.228405:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464b7de5400 uarg=0000000000000000 20000000:01000000:2.0:1787841820.228445:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787841820.228452:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787841820.228494:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787841820.231168:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787841820.234442:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787841820.240693:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787841820.240756:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787841820.240820:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787841820.240840:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787841820.240864:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240886:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240895:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240902:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240913:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240921:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240969:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.240989:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 9 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.241007:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481344:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841820.241154:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.241164:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 18 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.241182:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481472:0@lo:104: 00000100:00100000:0.0:1787841820.241234:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841820.241769:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.241780:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 18 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.241790:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481600:0@lo:104: 00000100:00100000:0.0:1787841820.241822:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841820.246100:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.246124:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 18 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.246141:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ad680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481728:0@lo:104: 00000100:00100000:0.0:1787841820.246194:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841820.247983:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787841820.248034:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841820.255200:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481344:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841820.259089:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481472 00000100:00100000:2.0:1787841820.259109:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481472 00000100:00100000:2.0:1787841820.259182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481600 00000100:00100000:2.0:1787841820.259206:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481600 00000100:00100000:2.0:1787841820.259225:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481728 00000100:00100000:2.0:1787841820.259228:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481728 00000100:00100000:2.0:1787841820.259257:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841820.259269:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+5:8507:x1874687877481472:12345-0@lo:104: 00010000:00010000:2.0:1787841820.259293:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259417:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787841820.259424:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+5:8507:x1874687877481472:12345-0@lo:104: Request processed in 158us (18190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.259431:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841820.259452:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787841820.259480:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+4:8507:x1874687877481600:12345-0@lo:104: 00010000:00010000:2.0:1787841820.259489:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259540:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787841820.259545:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+4:8507:x1874687877481600:12345-0@lo:104: Request processed in 68us (17723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.259551:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787841820.259585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787841820.259592:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:8507:x1874687877481728:12345-0@lo:104: 00010000:00010000:2.0:1787841820.259600:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259635:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787841820.259640:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:8507:x1874687877481728:12345-0@lo:104: Request processed in 49us (11609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.259653:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787841820.259693:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787841820.259701:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259709:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841820.259714:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259724:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841820.259732:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841820.259738:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841820.259776:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259782:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841820.259806:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259814:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480400/0x1d0ed3605e135dc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135dc9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259825:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841820.259829:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259845:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841820.259849:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259856:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841820.259862:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841820.259866:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841820.259882:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259888:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841820.259894:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259901:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464c2044400/0x1d0ed3605e135cf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259911:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841820.259914:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259920:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd200 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787841820.259923:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259940:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841820.259946:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841820.259952:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841820.259966:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259972:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841820.259986:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.259993:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dd200/0x1d0ed3605e135c95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135c9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260006:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841820.260008:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841820.260009:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841820.260016:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841820.260031:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877481856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841820.260072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841820.260116:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841820.260122:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877481984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841820.260143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841820.260167:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841820.260176:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877482112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841820.260224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841820.260251:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481856 00000100:00100000:2.0:1787841820.260255:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481856 00010000:00010000:2.0:1787841820.260280:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 19 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.260298:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877481984 00000100:00100000:2.0:1787841820.260301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877481984 00010000:00010000:2.0:1787841820.260312:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 20 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.260321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482112 00000100:00100000:2.0:1787841820.260323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482112 00010000:00010000:2.0:1787841820.260332:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 21 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.260343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787841820.260349:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+21:3306:x1874687877481856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841820.260360:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841820.260365:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 21 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260374:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 21 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260394:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841820.260422:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+21:3306:x1874687877481856:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.260429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787841820.260443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787841820.260493:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+20:3306:x1874687877481984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841820.260501:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841820.260516:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 20 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260525:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 20 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260535:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841820.260558:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+20:3306:x1874687877481984:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.260564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787841820.260578:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787841820.260585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877482112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841820.260592:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841820.260596:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 19 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260605:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 19 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.260613:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841820.260638:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877482112:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.260644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787841820.260682:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877482112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841820.260708:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877481984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841820.260715:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877481856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841820.260994:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841820.261233:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480000/0x1d0ed3605e135dc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135dc2 expref: 18 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.261259:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481472:0@lo:104: 00010000:00010000:1.0:1787841820.261270:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481200/0x1d0ed3605e135cfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135cf7 expref: 17 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.261279:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481600:0@lo:104: 00010000:00010000:1.0:1787841820.261288:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481600/0x1d0ed3605e135c9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135c95 expref: 16 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.261295:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ad680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1874687877481728:0@lo:104: 00010000:00010000:1.0:1787841820.261333:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.267618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841820.267872:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579200 00000100:00100000:0.0:1787841820.267886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579200 00010000:00010000:0.0:1787841820.267935:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.267981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:0.0:1787841820.267991:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858579200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841820.268009:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841820.268033:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268048:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268069:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481000/0x1d0ed3605e135e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9795e expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268090:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268100:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268118:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268125:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268132:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268139:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268145:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841820.268150:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268159:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268185:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.268197:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841820.268279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:2348:x1874687858579200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 288us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.268288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 24 00010000:00010000:1.0:1787841820.268652:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.268662:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.268669:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480a00/0x1d0ed3605e135f27 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.475264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841820.476274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579328 00000100:00100000:2.0:1787841820.476288:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579328 00000100:00100000:2.0:1787841820.476359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:2.0:1787841820.476371:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:5589:x1874687858579328:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841820.476392:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841820.476416:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d9799d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.476450:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.476485:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.476497:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044400, rc 0) 00000100:00100000:2.0:1787841820.476573:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579328:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 205us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.476580:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:0.0:1787841820.486883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841820.487225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579456 00000100:00100000:3.0:1787841820.487237:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579456 00000100:00100000:3.0:1787841820.487304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 174 00000100:00100000:3.0:1787841820.487317:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579456:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841820.487684:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579456:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 369us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.487693:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 174 00000100:00100000:2.0:1787841820.508387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841820.508736:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579584 00000100:00100000:0.0:1787841820.508749:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579584 00000100:00100000:0.0:1787841820.508808:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 175 00000100:00100000:0.0:1787841820.508819:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579584:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841820.509077:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:5589:x1874687858579584:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 258us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.509087:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 175 00000100:00100000:3.0:1787841820.521633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841820.523799:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579712 00000100:00100000:0.0:1787841820.523812:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579712 00000100:00100000:0.0:1787841820.523921:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 176 00000100:00100000:0.0:1787841820.523933:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:6104:x1874687858579712:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841820.524476:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:6104:x1874687858579712:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 522us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.524486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 176 00000100:00100000:1.0:1787841820.539141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841820.539183:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579840 00000100:00100000:1.0:1787841820.539193:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579840 00000100:00100000:1.0:1787841820.539246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 177 00000100:00100000:1.0:1787841820.539256:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:6104:x1874687858579840:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841820.539574:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:6104:x1874687858579840:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 318us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.539583:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 177 00000100:00100000:0.0:1787841820.958043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841820.961706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858579968 00000100:00100000:1.0:1787841820.961720:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858579968 00000100:00100000:1.0:1787841820.961789:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 178 00000100:00100000:1.0:1787841820.961800:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858579968:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841820.961902:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858579968:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 104us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.961911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 178 00000100:00100000:1.0:1787841820.971221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841820.971272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841820.971303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841820.971338:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580352 00000100:00100000:1.0:1787841820.971349:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580352 00000100:00100000:1.0:1787841820.971493:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580224 00000100:00100000:1.0:1787841820.971497:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580224 00000100:00100000:1.0:1787841820.971550:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:1.0:1787841820.971560:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858580352:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841820.971650:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858580352:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 91us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.971659:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:1.0:1787841820.971679:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:1.0:1787841820.971685:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858580224:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841820.971711:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858580224:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.971717:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00080000:1.0:1787841820.971734:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841820.971738:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841820.971983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580096 00000100:00100000:3.0:1787841820.971989:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580096 00000100:00100000:3.0:1787841820.972034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:3.0:1787841820.972041:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858580096:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841820.972101:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858580096:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 61us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.972107:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00080000:1.0:1787841820.973171:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787841821.172066:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787841822.130204:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787841822.130212:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464c1af7000 from 4 10000000:01000000:1.0:1787841822.130216:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841822.130264:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841822.130276:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841822.130297:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841822.130327:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841822.130404:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841822.130451:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841822.130499:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482240 00000100:00100000:1.0:1787841822.130505:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482240 00000100:00100000:1.0:1787841822.130554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787841822.130562:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877482240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841822.130577:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841822.130591:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135f35 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841822.132055:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841822.132075:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841822.132087:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:1.0:1787841822.132868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877482240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2299us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.132879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787841822.136785:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841822.136826:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.136841:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841822.136933:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.137011:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.138261:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841822.138844:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482368 00000100:00100000:1.0:1787841822.138854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482368 00000100:00100000:1.0:1787841822.138916:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787841822.138928:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877482368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841822.139442:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877482368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 515us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.139451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787841822.139635:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841822.139686:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841822.139739:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841822.139780:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841822.139902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482496 00000100:00100000:0.0:1787841822.139907:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482496 00000100:00100000:0.0:1787841822.139956:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787841822.139965:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877482496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841822.140146:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877482496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841822.140154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787841822.140200:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841822.156366:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8582:1874687877482624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841822.156792:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841822.156846:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841822.156914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482624 00000100:00100000:0.0:1787841822.156922:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482624 00000100:00100000:0.0:1787841822.157789:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787841822.157805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:8582:x1874687877482624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841822.158084:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:8582:x1874687877482624:12345-0@lo:502:llog_process_th.0 Request processed in 284us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841822.158092:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787841822.158230:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8582:1874687877482624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841822.158271:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841822.158284:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841822.158287:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787841822.158295:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464c1af7000 00000020:00000080:2.0:1787841822.158298:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787841822.158390:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8582:1874687877482752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841822.158434:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.162814:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841822.169733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482752 00000100:00100000:1.0:1787841822.169750:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482752 00000100:00100000:1.0:1787841822.169819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787841822.169830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:8582:x1874687877482752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841822.170137:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:8582:x1874687877482752:12345-0@lo:502:llog_process_th.0 Request processed in 308us (11702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.170145:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787841822.178776:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8582:1874687877482752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841822.178829:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841822.178840:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841822.178844:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787841822.178849:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787841822.182090:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787841822.182128:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841822.182144:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.182158:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841822.182170:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841822.182173:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946486706000 from 4 10000000:01000000:0.0:1787841822.182175:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841822.182226:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.182235:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.182260:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841822.182289:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841822.182365:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841822.184786:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d3de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.192671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877482880 00000100:00100000:2.0:1787841822.192689:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877482880 00000100:00100000:2.0:1787841822.192763:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787841822.192775:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877482880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841822.192798:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841822.192821:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135f43 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.192857:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.192870:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.192892:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841822.192980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877482880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (10615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.192987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787841822.193058:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877482880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841822.193083:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.193092:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841822.193170:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.193204:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.193233:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.193247:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483008 00000100:00100000:2.0:1787841822.193251:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483008 00000100:00100000:2.0:1787841822.193276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787841822.193282:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877483008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.193599:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877483008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.196738:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00010000:2.0:1787841822.196814:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841822.196861:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.196931:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.197031:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.197079:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.197122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483136 00000100:00100000:2.0:1787841822.197129:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483136 00000100:00100000:2.0:1787841822.197186:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787841822.197196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877483136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.197412:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877483136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.197419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787841822.197542:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.204834:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8589:1874687877483264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841822.204927:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.204982:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841822.205036:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483264 00000100:00100000:3.0:1787841822.205044:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483264 00000100:00100000:3.0:1787841822.205102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787841822.205113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:8589:x1874687877483264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841822.205340:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:8589:x1874687877483264:12345-0@lo:502:llog_process_th.0 Request processed in 228us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841822.205348:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787841822.207828:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8589:1874687877483264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841822.207876:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841822.207888:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841822.207890:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787841822.207899:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946486706000 00000020:00000080:2.0:1787841822.207902:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787841822.208014:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8589:1874687877483392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841822.208096:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.208121:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841822.208681:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483392 00000100:00100000:3.0:1787841822.208690:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483392 00000100:00100000:3.0:1787841822.208745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787841822.208755:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:8589:x1874687877483392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841822.208994:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:8589:x1874687877483392:12345-0@lo:502:llog_process_th.0 Request processed in 239us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841822.209001:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787841822.209126:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8589:1874687877483392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841822.209150:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841822.209157:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841822.209163:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787841822.209168:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787841822.210730:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787841822.210762:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841822.210775:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.210789:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841822.210799:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841822.210802:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946485cca000 from 4 10000000:01000000:3.0:1787841822.210804:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841822.210840:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.210848:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.210860:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841822.210884:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841822.210940:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841822.210979:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.212612:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483520 00000100:00100000:2.0:1787841822.212623:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483520 00000100:00100000:2.0:1787841822.212678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787841822.212689:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877483520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841822.212709:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841822.212729:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135f51 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.212762:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.212775:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.212785:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dee00, rc 0) 00000100:00100000:2.0:1787841822.212863:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877483520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.212870:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787841822.212932:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841822.212952:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.212963:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841822.213043:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.213075:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.213110:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.213123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483648 00000100:00100000:2.0:1787841822.213127:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483648 00000100:00100000:2.0:1787841822.213151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787841822.213156:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877483648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.213414:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877483648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.213422:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787841822.213451:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.213515:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.213550:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841822.213564:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.213575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483776 00000100:00100000:2.0:1787841822.213578:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483776 00000100:00100000:2.0:1787841822.213600:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787841822.213605:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877483776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841822.213745:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877483776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.213752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787841822.213790:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877483776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841822.221251:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8590:1874687877483904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841822.221355:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841822.221399:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.221523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877483904 00000100:00100000:2.0:1787841822.221530:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877483904 00000100:00100000:2.0:1787841822.221585:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787841822.221595:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:8590:x1874687877483904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841822.221842:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:8590:x1874687877483904:12345-0@lo:502:llog_process_th.0 Request processed in 247us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.221857:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787841822.222069:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8590:1874687877483904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787841822.222100:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841822.222109:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841822.222118:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787841822.222126:0:8590:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946485cca000 00000020:00000080:3.0:1787841822.222128:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787841822.222213:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8590:1874687877484032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841822.222251:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841822.222266:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787841822.222699:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484032 00000100:00100000:2.0:1787841822.222706:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484032 00000100:00100000:2.0:1787841822.222748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787841822.222757:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:8590:x1874687877484032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841822.222916:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:8590:x1874687877484032:12345-0@lo:502:llog_process_th.0 Request processed in 160us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.222924:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787841822.224578:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:8590:1874687877484032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787841822.224638:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841822.224648:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841822.224650:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787841822.224655:0:8590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787841822.224898:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787841822.224924:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787841822.224937:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.224949:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841822.962018:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877484160:0@lo:400:kworker.0 00000100:00100000:2.0:1787841822.962119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841822.962355:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484160 00000100:00100000:3.0:1787841822.962365:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484160 00000100:00100000:3.0:1787841822.962429:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841822.962439:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877484160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965013:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877484544:0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841822.965178:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787841822.965187:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787841822.965225:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877484416:0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841822.965278:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841822.965283:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877484288:0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841822.965332:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484416 00000100:00100000:1.0:1787841822.965339:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484416 00000100:00100000:1.0:1787841822.965397:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841822.965406:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877484416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965499:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877484416:12345-0@lo:400:kworker.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.965507:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787841822.965558:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841822.965571:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787841822.965577:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484544 00000100:00100000:1.0:1787841822.965581:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484544 00000100:00100000:1.0:1787841822.965604:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787841822.965609:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484288 00000100:00100000:1.0:1787841822.965611:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484288 00000100:00100000:1.0:1787841822.965623:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787841822.965629:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787841822.965635:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877484544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965672:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877484544:12345-0@lo:400:kworker.0 Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.965677:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787841822.965687:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787841822.965693:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787841822.965698:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877484288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965723:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877484288:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.965729:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787841822.965742:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841822.965771:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877484288:0@lo:400:kworker.0 00010000:00080000:1.0:1787841822.965784:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ae1c0 x1874687877484416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841822.965793:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877484416:0@lo:400:kworker.0 00000100:00100000:1.0:1787841822.965823:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877484544:0@lo:400:kworker.0 00000100:00100000:3.0:1787841822.983627:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877484160:12345-0@lo:400:kworker.0 Request processed in 21177us (21496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841822.983644:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787841822.983903:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877484160:0@lo:400:kworker.0 00000100:00100000:2.0:1787841822.984290:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877484672:0@lo:400:kworker.0 00000100:00100000:2.0:1787841822.984358:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841822.996077:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484672 00000100:00100000:0.0:1787841822.996095:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484672 00000100:00080000:1.0:1787841823.004294:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841823.005938:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787841823.005959:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841823.006147:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877484672:12345-0@lo:400:kworker.0 Request processed in 198us (21789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841823.006156:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787841823.007421:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867af840 x1874687877484672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841823.007440:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877484672:0@lo:400:kworker.0 00010000:00010000:2.0:1787841823.219898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841823.474217:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841823.474248:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877484800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841823.474334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841823.474411:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484800 00000100:00100000:0.0:1787841823.474420:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484800 00000100:00100000:0.0:1787841823.474512:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787841823.474523:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877484800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841823.474567:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841823.474630:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877484800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841823.474638:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787841823.474739:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946493293c00 x1874687877484800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841823.474759:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877484800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841823.986974:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841823.987002:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877484928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841823.987080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841823.987160:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877484928 00000100:00100000:3.0:1787841823.987169:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877484928 00000100:00100000:3.0:1787841823.987215:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787841823.987224:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877484928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841823.987263:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841823.987306:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877484928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841823.987313:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787841823.987923:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93c000 x1874687877484928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841823.987943:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877484928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841824.250490:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841825.272617:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841826.070567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841826.070618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841826.070703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841826.070730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841826.070761:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580736 00000100:00100000:1.0:1787841826.070773:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580736 00000100:00100000:1.0:1787841826.070831:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580864 00000100:00100000:1.0:1787841826.070834:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580864 00000100:00100000:1.0:1787841826.070857:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787841826.070868:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858580736:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841826.070949:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858580736:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841826.070957:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787841826.070975:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:1.0:1787841826.070982:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c9121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858580864:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841826.071007:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c9121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858580864:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841826.071014:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:1.0:1787841826.071034:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580608 00000100:00100000:1.0:1787841826.071038:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580608 00000100:00100000:1.0:1787841826.071070:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:1.0:1787841826.071077:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858580608:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841826.071106:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858580608:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841826.071112:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00080000:1.0:1787841826.071133:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841826.071152:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841826.071155:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841826.071371:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580480 00000100:00100000:0.0:1787841826.071377:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580480 00000100:00100000:0.0:1787841826.071417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 194 00000100:00100000:0.0:1787841826.071424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2347:x1874687858580480:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841826.071511:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2347:x1874687858580480:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 87us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841826.071519:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 194 00010000:00010000:0.0:1787841826.297232:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841827.319254:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841828.089853:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877485312:0@lo:400:kworker.0 00000100:00100000:2.0:1787841828.089925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841828.089981:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841828.089988:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877485440:0@lo:400:kworker.0 00000100:00100000:2.0:1787841828.090017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841828.090147:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877485184:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090178:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841828.090199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877485696:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841828.090285:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787841828.090292:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877485056:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841828.090348:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877485568:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841828.090416:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485312 00000100:00100000:0.0:1787841828.090424:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485312 00000100:00100000:0.0:1787841828.090533:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485184 00000100:00100000:0.0:1787841828.090537:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485184 00000100:00100000:0.0:1787841828.090549:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485568 00000100:00100000:0.0:1787841828.090551:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485568 00000100:00100000:0.0:1787841828.090566:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841828.090575:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877485312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090630:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877485312:12345-0@lo:400:kworker.0 Request processed in 57us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841828.090637:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841828.090655:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841828.090660:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877485184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090704:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877485184:12345-0@lo:400:kworker.0 Request processed in 43us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841828.090711:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841828.090723:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787841828.090730:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877485568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090756:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877485568:12345-0@lo:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841828.090761:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787841828.090800:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877485312:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090825:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877485568:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090833:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877485184:0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485056 00000100:00100000:0.0:1787841828.090865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485056 00000100:00100000:0.0:1787841828.090886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787841828.090891:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877485056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841828.090921:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877485056:12345-0@lo:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841828.090926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787841828.090953:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877485056:0@lo:400:kworker.0 00000100:00100000:1.0:1787841828.091098:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485440 00000100:00100000:1.0:1787841828.091103:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485440 00000100:00100000:1.0:1787841828.091135:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485696 00000100:00100000:1.0:1787841828.091138:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485696 00000100:00100000:1.0:1787841828.091151:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841828.091157:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877485440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841828.091192:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877485440:12345-0@lo:400:kworker.0 Request processed in 36us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841828.091198:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841828.091208:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787841828.091213:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841828.091237:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877485696:12345-0@lo:400:kworker.0 Request processed in 24us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841828.091241:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787841828.091258:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841828.091261:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841828.091263:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841828.091281:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98bb0c0 x1874687877485440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841828.091292:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877485440:0@lo:400:kworker.0 00010000:00080000:1.0:1787841828.091309:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98b8f00 x1874687877485696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841828.091318:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877485696:0@lo:400:kworker.0 00010000:00010000:0.0:1787841828.337757:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841828.451716:0:8808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1787841828.601843:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877485824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841828.601929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841828.602371:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485824 00000100:00100000:3.0:1787841828.602383:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485824 00000100:00100000:3.0:1787841828.603980:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787841828.604010:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877485824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841828.604069:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841828.604196:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877485824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841828.604205:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787841828.604299:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ac3c0 x1874687877485824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841828.604346:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877485824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841829.116293:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841829.116328:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463823512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877485952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841829.116397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841829.116494:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877485952 00000100:00100000:1.0:1787841829.116503:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877485952 00000100:00100000:1.0:1787841829.116916:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787841829.116928:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877485952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841829.116973:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841829.117159:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877485952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841829.117167:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787841829.118838:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9463823512c0 x1874687877485952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841829.118862:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463823512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877485952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841829.361987:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841830.386139:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841831.190232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841831.191557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841831.191842:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581120 00000100:00100000:1.0:1787841831.191857:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581120 00000100:00100000:1.0:1787841831.191952:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:1.0:1787841831.191964:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858581120:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841831.192060:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858581120:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 97us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841831.192067:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00080000:0.0:1787841831.192207:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841831.195156:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858580992 00000100:00100000:2.0:1787841831.195171:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858580992 00000100:00100000:2.0:1787841831.195252:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 196 00000100:00100000:2.0:1787841831.195265:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858580992:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841831.195353:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858580992:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 92us (5133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841831.195361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 196 00000100:00100000:0.0:1787841831.218237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841831.218292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841831.218325:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581248 00000100:00100000:0.0:1787841831.218337:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581248 00000100:00100000:0.0:1787841831.218390:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581376 00000100:00100000:0.0:1787841831.218393:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581376 00000100:00100000:0.0:1787841831.218427:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:0.0:1787841831.218437:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2345:x1874687858581248:12345-192.168.202.46@tcp:9:kworker.0 00000020:00000080:0.0:1787841831.218511:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e94 00000100:00080000:0.0:1787841831.218524:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9464bf97d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841831.218565:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787841831.219362:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+2:2345:x1874687858581248:12345-192.168.202.46@tcp:9:kworker.0 Request processed in 922us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841831.219373:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:0.0:1787841831.219398:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:0.0:1787841831.219418:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2345:x1874687858581376:12345-192.168.202.46@tcp:9:kworker.0 00000020:00000080:0.0:1787841831.219438:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e9b 00000100:00080000:0.0:1787841831.219447:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9464bf97b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841831.219500:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787841831.219737:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+2:2345:x1874687858581376:12345-192.168.202.46@tcp:9:kworker.0 Request processed in 330us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841831.219744:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00080000:0.0:1787841831.219776:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841831.219780:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787841831.220533:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841831.220791:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841831.410451:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841832.433694:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841833.202012:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877486208:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202105:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841833.202185:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877486720:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841833.202246:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787841833.202252:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877486080:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202281:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841833.202324:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877486592:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841833.202375:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877486336:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841833.202430:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841833.202435:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877486464:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841833.202504:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486208 00000100:00100000:2.0:1787841833.202511:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486208 00000100:00100000:2.0:1787841833.202563:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486592 00000100:00100000:2.0:1787841833.202567:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486592 00000100:00100000:2.0:1787841833.202592:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486336 00000100:00100000:2.0:1787841833.202595:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486336 00000100:00100000:2.0:1787841833.202614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787841833.202624:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877486208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202690:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877486208:12345-0@lo:400:kworker.0 Request processed in 67us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.202699:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787841833.202718:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787841833.202725:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877486592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202753:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877486592:12345-0@lo:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.202758:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787841833.202770:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787841833.202776:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877486336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202807:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877486336:12345-0@lo:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.202822:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787841833.202841:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486720 00000100:00100000:2.0:1787841833.202845:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486720 00000100:00100000:2.0:1787841833.202869:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486464 00000100:00100000:2.0:1787841833.202873:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486464 00000100:00100000:2.0:1787841833.202887:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787841833.202894:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877486720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202925:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877486720:12345-0@lo:400:kworker.0 Request processed in 32us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.202932:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787841833.202943:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787841833.202950:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877486464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.202979:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877486464:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.202985:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787841833.203005:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486080 00000100:00100000:2.0:1787841833.203009:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486080 00000100:00100000:2.0:1787841833.203037:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787841833.203044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877486080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.203075:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877486080:12345-0@lo:400:kworker.0 Request processed in 32us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.203081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1787841833.203125:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841833.203129:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841833.203132:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787841833.203169:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98ba1c0 x1874687877486464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841833.203200:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877486464:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.203215:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877486336:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.203246:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877486080:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.203257:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877486592:0@lo:400:kworker.0 00000100:00100000:2.0:1787841833.203267:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877486208:0@lo:400:kworker.0 00010000:00080000:2.0:1787841833.203276:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98bb0c0 x1874687877486720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841833.203286:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877486720:0@lo:400:kworker.0 00010000:00010000:2.0:1787841833.459471:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841833.716923:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877486848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841833.717005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841833.717098:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486848 00000100:00100000:1.0:1787841833.717106:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486848 00000100:00100000:1.0:1787841833.717171:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841833.717181:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877486848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841833.717227:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841833.717280:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877486848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841833.717289:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787841833.717335:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382353840 x1874687877486848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841833.717355:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877486848:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787841833.795956:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:1.0:1787841833.795968:0:6718:0:(genops.c:885:class_export_put()) final put ffff9464bf97f800/7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:2.0:1787841833.796233:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bf97f800/7142e368-78a3-4f67-bb12-5e4ed629eb65 for lustre-OST0000 00000020:00000080:2.0:1787841833.796285:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464bf97d000 for lustre-OST0000 00000100:00100000:2.0:1787841834.242431:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841834.242496:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877486976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841834.242603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841834.243154:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877486976 00000100:00100000:1.0:1787841834.243164:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877486976 00000100:00100000:1.0:1787841834.243225:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787841834.243236:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877486976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841834.243275:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841834.243344:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877486976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841834.243351:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787841834.243454:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382353840 x1874687877486976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841834.243504:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877486976:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787841834.327899:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:1.0:1787841834.327912:0:7646:0:(genops.c:885:class_export_put()) final put ffff9464bf978800/7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:3.0:1787841834.328049:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bf978800/7142e368-78a3-4f67-bb12-5e4ed629eb65 for lustre-OST0001 00000020:00000080:3.0:1787841834.328122:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464bf97b800 for lustre-OST0001 00010000:00010000:2.0:1787841834.482483:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841835.152963:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing yml_node 00010000:00010000:0.0:1787841835.508089:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841836.306869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841836.306935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841836.307070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581504 00000100:00100000:3.0:1787841836.307083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581504 00000100:00100000:3.0:1787841836.307151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 198 00000100:00100000:3.0:1787841836.307161:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2347:x1874687858581504:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841836.307245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2347:x1874687858581504:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 86us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841836.307268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 198 00000100:00100000:1.0:1787841836.308127:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581632 00000100:00100000:1.0:1787841836.308139:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581632 00000100:00100000:1.0:1787841836.308261:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:1.0:1787841836.308272:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858581632:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841836.308346:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858581632:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 77us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841836.308375:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00080000:2.0:1787841836.316668:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841836.534496:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841837.553710:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841838.321964:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841838.321992:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877487360:0@lo:400:kworker.0 00000100:00100000:3.0:1787841838.322070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841838.322206:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877487104:0@lo:400:kworker.0 00000100:00100000:1.0:1787841838.322246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841838.322281:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487104 00000100:00100000:1.0:1787841838.322289:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487104 00000100:00100000:1.0:1787841838.322355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787841838.322367:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877487104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841838.322420:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877487104:12345-0@lo:400:kworker.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841838.322427:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787841838.322764:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877487232:0@lo:400:kworker.0 00000100:00100000:2.0:1787841838.322797:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841838.322843:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487360 00000100:00100000:0.0:1787841838.322844:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841838.322860:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487360 00000100:00100000:0.0:1787841838.322866:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877487488:0@lo:400:kworker.0 00000100:00100000:2.0:1787841838.322898:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487232 00000100:00100000:0.0:1787841838.322900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841838.322901:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487232 00000100:00100000:2.0:1787841838.322919:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787841838.322926:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841838.322956:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487488 00000100:00100000:2.0:1787841838.322960:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877487360:12345-0@lo:400:kworker.0 Request processed in 35us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.322960:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487488 00000100:00100000:2.0:1787841838.322966:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787841838.322979:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787841838.322984:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841838.322988:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841838.322994:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877487488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841838.323014:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877487232:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841838.323019:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841838.323022:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877487488:12345-0@lo:400:kworker.0 Request processed in 29us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.323028:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787841838.323042:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841838.323046:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841838.323320:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877487360:0@lo:400:kworker.0 00000100:00100000:1.0:1787841838.323414:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877487104:0@lo:400:kworker.0 00000100:00100000:1.0:1787841838.323430:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877487616:0@lo:400:kworker.0 00000100:00100000:1.0:1787841838.323475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841838.323548:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487616 00000100:00100000:3.0:1787841838.323553:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487616 00000100:00100000:3.0:1787841838.323605:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787841838.323612:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877487616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841838.323650:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877487616:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841838.323656:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787841838.323819:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877487616:0@lo:400:kworker.0 00000100:00100000:2.0:1787841838.323956:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877487232:0@lo:400:kworker.0 00000100:00100000:2.0:1787841838.323964:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877487744:0@lo:400:kworker.0 00000100:00100000:2.0:1787841838.323989:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787841838.324088:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382350f00 x1874687877487488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841838.324099:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877487488:0@lo:400:kworker.0 00000100:00100000:3.0:1787841838.324289:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487744 00000100:00100000:3.0:1787841838.324294:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487744 00000100:00100000:3.0:1787841838.324331:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787841838.324350:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877487744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841838.324402:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877487744:12345-0@lo:400:kworker.0 Request processed in 64us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841838.324409:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787841838.324489:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382352d00 x1874687877487744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841838.324500:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877487744:0@lo:400:kworker.0 00000100:00080000:0.0:1787841838.324668:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841838.324674:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841838.581262:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841838.833652:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841838.833678:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877487872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841838.833752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841838.833868:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877487872 00000100:00100000:1.0:1787841838.833875:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877487872 00000100:00100000:1.0:1787841838.833930:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787841838.833953:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877487872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841838.833989:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841838.834042:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877487872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841838.834049:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787841838.834754:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382352d00 x1874687877487872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841838.834775:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877487872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841839.345895:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877488000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841839.345980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841839.346554:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488000 00000100:00100000:3.0:1787841839.346564:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488000 00000100:00100000:3.0:1787841839.346624:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787841839.346634:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877488000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841839.346674:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841839.346739:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877488000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841839.346760:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787841839.346848:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867af480 x1874687877488000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841839.346867:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877488000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841839.602482:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841840.625650:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841840.816102:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.92 00000100:00100000:3.0:1787841841.441107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841841.441192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841841.441229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581760 00000100:00100000:3.0:1787841841.441242:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581760 00000100:00100000:3.0:1787841841.441332:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 200 00000100:00100000:3.0:1787841841.441343:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858581760:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841841.441418:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858581760:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.441426:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 200 00000100:00100000:3.0:1787841841.441730:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858581888 00000100:00100000:3.0:1787841841.441735:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858581888 00000100:00100000:3.0:1787841841.441778:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:3.0:1787841841.441786:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858581888:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841841.441817:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858581888:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.441824:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00080000:3.0:1787841841.441928:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841841.651048:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841842.673809:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841843.442840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877488384:0@lo:400:kworker.0 00000100:00100000:2.0:1787841843.442943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841843.443037:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488384 00000100:00100000:2.0:1787841843.443045:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488384 00000100:00100000:2.0:1787841843.443098:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787841843.443108:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877488384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841843.443161:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877488384:12345-0@lo:400:kworker.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.443168:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787841843.443189:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841843.443217:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877488384:0@lo:400:kworker.0 00000100:00100000:2.0:1787841843.443257:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877488512:0@lo:400:kworker.0 00000100:00100000:2.0:1787841843.443285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.443409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877488256:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.443500:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a743c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877488768:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.443559:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787841843.443566:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877488128:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.443616:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a740780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877488640:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.443663:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488512 00000100:00100000:0.0:1787841843.443666:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488512 00000100:00100000:0.0:1787841843.443700:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488768 00000100:00100000:0.0:1787841843.443703:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488768 00000100:00100000:0.0:1787841843.443720:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841843.443726:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877488512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443764:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877488512:12345-0@lo:400:kworker.0 Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.443771:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841843.443786:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841843.443791:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877488768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443821:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877488768:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.443827:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841843.443846:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488128 00000100:00100000:0.0:1787841843.443849:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488128 00000100:00100000:0.0:1787841843.443872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787841843.443877:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877488128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.443918:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877488128:12345-0@lo:400:kworker.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.443924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787841843.443951:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488256 00000100:00100000:0.0:1787841843.443960:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488256 00000100:00100000:0.0:1787841843.443981:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488640 00000100:00100000:0.0:1787841843.443983:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488640 00000100:00100000:0.0:1787841843.444000:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787841843.444006:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877488256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.444035:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877488256:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.444041:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787841843.444051:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787841843.444057:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877488640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.444079:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877488640:12345-0@lo:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.444085:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787841843.444106:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841843.444110:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841843.444112:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787841843.444134:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a743840 x1874687877488512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841843.444145:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a743840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877488512:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.444174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877488128:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.444184:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a740780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877488640:0@lo:400:kworker.0 00000100:00100000:0.0:1787841843.444192:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877488256:0@lo:400:kworker.0 00010000:00080000:0.0:1787841843.444201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a743c00 x1874687877488768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841843.444209:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a743c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877488768:0@lo:400:kworker.0 00010000:00010000:0.0:1787841843.697667:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841843.955008:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841843.955092:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877488896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841843.955177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841843.955262:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877488896 00000100:00100000:3.0:1787841843.955289:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877488896 00000100:00100000:3.0:1787841843.955342:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841843.955352:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877488896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841843.955415:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841843.955522:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877488896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841843.955529:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787841843.955575:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382350f00 x1874687877488896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841843.955600:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877488896:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787841844.167696:0:9345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.92 00000100:00100000:1.0:1787841844.469659:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877489024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841844.469739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841844.469815:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489024 00000100:00100000:1.0:1787841844.469824:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489024 00000100:00100000:1.0:1787841844.469874:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787841844.469884:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877489024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841844.469922:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841844.469967:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877489024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841844.469975:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787841844.470316:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382353c00 x1874687877489024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841844.470351:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877489024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841844.722378:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841845.745789:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841846.547772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841846.547827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841846.547950:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582144 00000100:00100000:1.0:1787841846.547962:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582144 00000100:00100000:1.0:1787841846.548055:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:1.0:1787841846.548068:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858582144:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841846.548188:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858582144:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841846.548196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00080000:0.0:1787841846.548338:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841846.548443:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582016 00000100:00100000:3.0:1787841846.548494:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582016 00000100:00100000:3.0:1787841846.548528:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 202 00000100:00100000:3.0:1787841846.548536:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858582016:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841846.548565:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858582016:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841846.548571:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 202 00010000:00010000:2.0:1787841846.769816:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841847.094001:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.92 00010000:00010000:0.0:1787841847.795557:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841848.568491:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877489280:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.568570:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841848.568631:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877489792:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.568657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841848.568915:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877489152:0@lo:400:kworker.0 00000100:00100000:2.0:1787841848.568958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841848.568989:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877489664:0@lo:400:kworker.0 00000100:00100000:2.0:1787841848.569014:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841848.569051:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489280 00000100:00100000:1.0:1787841848.569051:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489152 00000100:00100000:2.0:1787841848.569059:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489280 00000100:00100000:1.0:1787841848.569059:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489152 00000100:00100000:2.0:1787841848.569103:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489664 00000100:00100000:2.0:1787841848.569105:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489664 00000100:00100000:1.0:1787841848.569108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787841848.569116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877489152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841848.569145:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787841848.569151:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877489280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841848.569168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877489152:12345-0@lo:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841848.569175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787841848.569180:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877489280:12345-0@lo:400:kworker.0 Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841848.569201:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787841848.569208:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787841848.569215:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877489664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841848.569255:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877489664:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841848.569260:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787841848.569382:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877489280:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569411:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877489408:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841848.569490:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841848.569497:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877489536:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841848.569551:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489408 00000100:00100000:1.0:1787841848.569556:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489408 00000100:00100000:3.0:1787841848.569564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489792 00000100:00100000:3.0:1787841848.569566:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489792 00000100:00100000:1.0:1787841848.569579:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787841848.569584:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877489408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569589:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489536 00000100:00100000:3.0:1787841848.569592:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489536 00000100:00100000:3.0:1787841848.569607:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787841848.569614:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877489792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841848.569617:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877489408:12345-0@lo:400:kworker.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841848.569622:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787841848.569646:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877489152:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569647:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877489792:12345-0@lo:400:kworker.0 Request processed in 34us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841848.569653:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787841848.569656:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877489664:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569663:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787841848.569668:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877489536:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787841848.569681:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841848.569690:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841848.569692:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841848.569868:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877489536:12345-0@lo:400:kworker.0 Request processed in 199us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841848.569876:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787841848.569915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93fc00 x1874687877489536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841848.569926:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877489536:0@lo:400:kworker.0 00000100:00100000:3.0:1787841848.569936:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877489408:0@lo:400:kworker.0 00010000:00080000:3.0:1787841848.569975:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93f840 x1874687877489792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841848.569984:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877489792:0@lo:400:kworker.0 00010000:00010000:3.0:1787841848.817903:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841848.848223:0:9491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 10:44:08 EDT 2026 00000100:00100000:2.0:1787841849.073862:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841849.073896:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877489920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841849.073988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841849.074824:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877489920 00000100:00100000:1.0:1787841849.074834:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877489920 00000100:00100000:1.0:1787841849.074893:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787841849.074903:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877489920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841849.074939:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841849.074999:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877489920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841849.075006:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787841849.075051:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382353840 x1874687877489920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841849.075069:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877489920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841849.603656:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877490048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841849.603778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841849.604091:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490048 00000100:00100000:0.0:1787841849.604102:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490048 00000100:00100000:0.0:1787841849.604678:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841849.604696:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877490048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841849.604748:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841849.604862:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877490048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841849.604870:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787841849.604935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867acf00 x1874687877490048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841849.604959:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877490048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841849.845010:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841850.865647:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841851.662900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841851.662952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841851.662999:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582400 00000100:00100000:3.0:1787841851.663009:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582400 00000100:00100000:3.0:1787841851.663079:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:3.0:1787841851.663090:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858582400:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841851.663181:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858582400:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841851.663189:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:1.0:1787841851.664191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582272 00000100:00100000:1.0:1787841851.664200:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582272 00000100:00100000:1.0:1787841851.664255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 204 00000100:00100000:1.0:1787841851.664265:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2347:x1874687858582272:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841851.664313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2347:x1874687858582272:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 49us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841851.664320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 204 00000100:00080000:1.0:1787841851.664350:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841851.893116:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841852.913758:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841853.681820:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877490176:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.681891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841853.681927:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877490688:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.681947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841853.681970:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787841853.681974:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877490304:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.681987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841853.681996:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877490816:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841853.682049:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877490432:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841853.682088:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841853.682093:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877490560:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841853.682144:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490176 00000100:00100000:3.0:1787841853.682151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490176 00000100:00100000:3.0:1787841853.682210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787841853.682227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877490176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682279:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877490176:12345-0@lo:400:kworker.0 Request processed in 54us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.682286:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787841853.682322:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490688 00000100:00100000:3.0:1787841853.682326:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490688 00000100:00100000:3.0:1787841853.682374:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490304 00000100:00100000:3.0:1787841853.682378:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490304 00000100:00100000:3.0:1787841853.682392:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490432 00000100:00100000:3.0:1787841853.682395:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490432 00000100:00100000:3.0:1787841853.682416:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841853.682423:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877490688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682485:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877490688:12345-0@lo:400:kworker.0 Request processed in 62us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.682492:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841853.682505:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787841853.682511:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877490304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682542:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877490304:12345-0@lo:400:kworker.0 Request processed in 31us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.682548:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787841853.682560:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787841853.682567:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877490432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682600:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877490432:12345-0@lo:400:kworker.0 Request processed in 34us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.682606:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787841853.682629:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490816 00000100:00100000:3.0:1787841853.682633:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490816 00000100:00100000:3.0:1787841853.682673:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490560 00000100:00100000:3.0:1787841853.682677:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490560 00000100:00100000:3.0:1787841853.682692:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787841853.682698:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877490816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682728:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877490816:12345-0@lo:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.682734:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787841853.682744:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841853.682750:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877490560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.682793:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877490560:12345-0@lo:400:kworker.0 Request processed in 43us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.682799:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787841853.682826:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841853.682830:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841853.682832:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841853.683086:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877490304:0@lo:400:kworker.0 00010000:00080000:2.0:1787841853.683110:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464903ead00 x1874687877490816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787841853.683111:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464903e8f00 x1874687877490560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841853.683139:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877490816:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.683141:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877490560:0@lo:400:kworker.0 00000100:00100000:2.0:1787841853.683163:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877490176:0@lo:400:kworker.0 00000100:00100000:3.0:1787841853.683166:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877490432:0@lo:400:kworker.0 00000100:00100000:2.0:1787841853.683186:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877490688:0@lo:400:kworker.0 00010000:00010000:2.0:1787841853.941322:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841854.196859:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877490944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841854.196976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841854.199567:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877490944 00000100:00100000:1.0:1787841854.199583:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877490944 00000100:00100000:1.0:1787841854.199654:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787841854.199665:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877490944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841854.199709:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841854.199890:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877490944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841854.199905:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787841854.199957:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464903e8f00 x1874687877490944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841854.199980:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877490944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841854.707595:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877491072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841854.707685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841854.711632:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491072 00000100:00100000:0.0:1787841854.711651:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491072 00000100:00100000:0.0:1787841854.711725:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787841854.711736:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877491072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841854.711778:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841854.711882:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877491072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (4196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841854.711905:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787841854.711958:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ae940 x1874687877491072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841854.711981:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877491072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841854.965211:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841855.985655:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841856.784996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841856.785041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841856.785078:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582528 00000100:00100000:3.0:1787841856.785092:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582528 00000100:00100000:3.0:1787841856.785173:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 206 00000100:00100000:3.0:1787841856.785187:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858582528:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841856.786394:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858582528:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 1205us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841856.786404:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 206 00000100:00100000:3.0:1787841856.786453:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582656 00000100:00100000:3.0:1787841856.786482:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582656 00000100:00100000:3.0:1787841856.786533:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:3.0:1787841856.786543:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858582656:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841856.786576:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858582656:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 36us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841856.786583:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00080000:3.0:1787841856.786727:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841857.010668:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841858.038112:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841858.803940:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a7421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877491456:0@lo:400:kworker.0 00000100:00100000:1.0:1787841858.804014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841858.804075:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841858.804081:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877491584:0@lo:400:kworker.0 00000100:00100000:1.0:1787841858.804119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841858.804179:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491584 00000100:00100000:1.0:1787841858.804187:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491584 00000100:00100000:1.0:1787841858.804252:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787841858.804271:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841858.804325:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877491584:12345-0@lo:400:kworker.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841858.804332:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787841858.804357:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787841858.804400:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a740000 x1874687877491584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841858.804424:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877491584:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.804726:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a741e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877491200:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.804770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841858.804795:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877491712:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.804817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841858.804838:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787841858.804844:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a740b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877491328:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.804866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841858.804883:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877491840:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.804905:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841858.804933:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491456 00000100:00100000:3.0:1787841858.804937:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491456 00000100:00100000:3.0:1787841858.804983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491712 00000100:00100000:3.0:1787841858.804987:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491712 00000100:00100000:3.0:1787841858.805001:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491328 00000100:00100000:3.0:1787841858.805004:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491328 00000100:00100000:3.0:1787841858.805017:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787841858.805023:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877491456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.805063:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877491456:12345-0@lo:400:kworker.0 Request processed in 40us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841858.805070:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787841858.805085:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787841858.805092:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877491712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.805125:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877491712:12345-0@lo:400:kworker.0 Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841858.805131:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787841858.805153:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787841858.805160:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877491328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841858.805429:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491200 00000100:00100000:1.0:1787841858.805433:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491200 00000100:00100000:1.0:1787841858.805482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787841858.805489:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841858.805523:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877491200:12345-0@lo:400:kworker.0 Request processed in 36us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841858.805537:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:1.0:1787841858.805568:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841858.805593:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a7421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877491456:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.805854:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877491328:12345-0@lo:400:kworker.0 Request processed in 694us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841858.805861:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787841858.805897:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a740b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877491328:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.805907:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a741e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877491200:0@lo:400:kworker.0 00000100:00100000:3.0:1787841858.805917:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a741680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877491712:0@lo:400:kworker.0 00000100:00100000:0.0:1787841858.806192:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491840 00000100:00100000:0.0:1787841858.806198:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491840 00000100:00100000:0.0:1787841858.806237:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787841858.806245:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877491840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841858.806662:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877491840:12345-0@lo:400:kworker.0 Request processed in 416us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841858.806669:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787841858.806805:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a742d00 x1874687877491840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841858.806818:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a742d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877491840:0@lo:400:kworker.0 00000100:00080000:1.0:1787841858.806876:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787841859.067618:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841859.342782:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877491968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841859.342858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841859.343954:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877491968 00000100:00100000:0.0:1787841859.343965:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877491968 00000100:00100000:0.0:1787841859.344030:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787841859.344042:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877491968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841859.344220:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841859.344307:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877491968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841859.344315:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787841859.344378:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382353c00 x1874687877491968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841859.344404:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877491968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841859.826604:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841859.826633:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877492096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841859.826773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841859.826874:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492096 00000100:00100000:3.0:1787841859.826885:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492096 00000100:00100000:3.0:1787841859.826947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841859.826958:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877492096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841859.827014:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841859.827068:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877492096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841859.827076:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787841859.827114:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382350f00 x1874687877492096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841859.827150:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877492096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841860.081562:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841861.109020:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841861.913699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841861.913767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841861.914047:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582784 00000100:00100000:0.0:1787841861.914063:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582784 00000100:00100000:0.0:1787841861.914151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 208 00000100:00100000:0.0:1787841861.914164:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2349:x1874687858582784:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841861.914255:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2349:x1874687858582784:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 94us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841861.914263:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 208 00000100:00100000:2.0:1787841861.914698:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858582912 00000100:00100000:2.0:1787841861.914704:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858582912 00000100:00100000:2.0:1787841861.914762:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:2.0:1787841861.914772:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858582912:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841861.914840:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858582912:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 70us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841861.914847:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00080000:3.0:1787841861.914917:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841862.129938:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841863.155898:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841863.924745:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877492608:0@lo:400:kworker.0 00000100:00100000:0.0:1787841863.924867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841863.924951:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841863.924958:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877492480:0@lo:400:kworker.0 00000100:00100000:0.0:1787841863.924987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841863.925078:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877492224:0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841863.925187:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877492736:0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925216:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841863.925234:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787841863.925240:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877492352:0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841863.925279:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877492864:0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841863.925333:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492480 00000100:00100000:2.0:1787841863.925341:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492480 00000100:00100000:2.0:1787841863.925397:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492736 00000100:00100000:2.0:1787841863.925401:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492736 00000100:00100000:2.0:1787841863.925417:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492352 00000100:00100000:2.0:1787841863.925419:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492352 00000100:00100000:2.0:1787841863.925435:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787841863.925444:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877492480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925530:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877492480:12345-0@lo:400:kworker.0 Request processed in 87us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841863.925538:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787841863.925554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787841863.925561:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877492736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925593:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877492736:12345-0@lo:400:kworker.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841863.925609:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787841863.925621:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787841863.925628:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877492352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925657:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877492352:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841863.925663:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787841863.925699:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877492352:0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.925711:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877492736:0@lo:400:kworker.0 00000100:00100000:1.0:1787841863.925810:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492608 00000100:00100000:1.0:1787841863.925815:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492608 00000100:00100000:1.0:1787841863.925856:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492864 00000100:00100000:1.0:1787841863.925860:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492864 00000100:00100000:1.0:1787841863.925877:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787841863.925883:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877492608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841863.925918:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877492608:12345-0@lo:400:kworker.0 Request processed in 36us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841863.925923:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787841863.925935:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787841863.925940:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877492864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841863.925967:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877492864:12345-0@lo:400:kworker.0 Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841863.925972:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787841863.926044:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946493290b40 x1874687877492864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841863.926055:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877492864:0@lo:400:kworker.0 00000100:00080000:3.0:1787841863.926158:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841863.926163:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841863.926166:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841863.926232:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492224 00000100:00100000:0.0:1787841863.926237:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492224 00000100:00100000:0.0:1787841863.926275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787841863.926282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877492224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841863.926327:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877492224:12345-0@lo:400:kworker.0 Request processed in 45us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841863.926333:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787841863.926380:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877492480:0@lo:400:kworker.0 00010000:00080000:0.0:1787841863.926393:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ae1c0 x1874687877492608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841863.926402:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877492608:0@lo:400:kworker.0 00000100:00100000:2.0:1787841863.926485:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877492224:0@lo:400:kworker.0 00010000:00010000:3.0:1787841864.177603:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841864.435184:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877492992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841864.435273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841864.435544:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877492992 00000100:00100000:3.0:1787841864.435554:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877492992 00000100:00100000:3.0:1787841864.435607:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787841864.435617:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877492992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841864.435668:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841864.435747:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877492992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841864.435755:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787841864.435950:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382353c00 x1874687877492992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841864.435975:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877492992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841864.947364:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841864.947395:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877493120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841864.947493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841864.948665:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493120 00000100:00100000:3.0:1787841864.948699:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493120 00000100:00100000:3.0:1787841864.948766:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787841864.948776:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877493120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841864.948815:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841864.948888:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877493120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841864.948896:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787841864.948941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382350f00 x1874687877493120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841864.948962:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877493120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841865.201789:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841865.970667:0:10122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:44:25 (1787841865) === 00010000:00010000:1.0:1787841866.239477:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841866.550288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841866.550658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583040 00000100:00100000:1.0:1787841866.550680:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583040 00000100:00100000:1.0:1787841866.550787:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 210 00000100:00100000:1.0:1787841866.550811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:8131:x1874687858583040:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787841866.550840:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841866.550869:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946481499c00/0x1d0ed3605e135f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d979a4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841866.550918:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946481499c00/0x1d0ed3605e135f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979a4 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841866.550934:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946481499c00/0x1d0ed3605e135f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979a4 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841866.550948:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499c00, rc 0) 00000100:00100000:1.0:1787841866.551050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8131:x1874687858583040:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 242us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841866.551059:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 210 00000100:00100000:0.0:1787841866.567780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841866.568183:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583168 00000100:00100000:3.0:1787841866.568200:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583168 00000100:00100000:3.0:1787841866.568295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 211 00000100:00100000:3.0:1787841866.568309:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8131:x1874687858583168:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787841866.569277:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8131:x1874687858583168:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 963us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841866.569288:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 211 00000100:00100000:1.0:1787841866.590922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841866.591078:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583296 00000100:00100000:0.0:1787841866.591092:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583296 00000100:00100000:0.0:1787841866.591168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 212 00000100:00100000:0.0:1787841866.591181:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8131:x1874687858583296:12345-192.168.202.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787841866.591523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8131:x1874687858583296:12345-192.168.202.46@tcp:503:mount.lustre.0 Request processed in 343us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.591534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 212 00000100:00100000:1.0:1787841866.594220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841866.595062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583424 00000100:00100000:3.0:1787841866.595095:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583424 00000100:00100000:3.0:1787841866.595204:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 213 00000100:00100000:3.0:1787841866.595216:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8135:x1874687858583424:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787841866.595677:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8135:x1874687858583424:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 463us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841866.595687:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 213 00000100:00100000:2.0:1787841866.624033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841866.627366:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583552 00000100:00100000:1.0:1787841866.627390:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583552 00000100:00100000:1.0:1787841866.627548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 214 00000100:00100000:1.0:1787841866.627562:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8135:x1874687858583552:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841866.627981:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8135:x1874687858583552:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 419us (3962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841866.627990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 214 00000100:00100000:1.0:1787841866.640355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841866.640946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583680 00000100:00100000:0.0:1787841866.640960:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583680 00000100:00100000:0.0:1787841866.641063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 215 00000100:00100000:0.0:1787841866.641086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:8131:x1874687858583680:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787841866.641111:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841866.641137:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481800/0x1d0ed3605e135f66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d979ce expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841866.641177:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481800/0x1d0ed3605e135f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ce expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841866.641191:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481800/0x1d0ed3605e135f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ce expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841866.641203:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481800, rc 0) 00000100:00100000:0.0:1787841866.641291:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:8131:x1874687858583680:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 208us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.641321:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 215 00000100:00100000:2.0:1787841866.646930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841866.648883:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583808 00000100:00100000:3.0:1787841866.648911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583808 00000100:00100000:3.0:1787841866.649037:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 216 00000100:00100000:3.0:1787841866.649053:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:8131:x1874687858583808:12345-192.168.202.46@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787841866.649112:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787841866.649154:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787841866.649160:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787841866.649163:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787841866.649166:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787841866.655035:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:8131:x1874687858583808:12345-192.168.202.46@tcp:256:mount.lustre.0 Request processed in 5961us (8098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841866.655062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 216 00000100:00100000:1.0:1787841866.659859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841866.660103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858583936 00000100:00100000:3.0:1787841866.660119:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858583936 00000100:00100000:3.0:1787841866.660202:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 217 00000100:00100000:3.0:1787841866.660214:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:8131:x1874687858583936:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787841866.660240:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841866.660263:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d979d5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841866.660310:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841866.660324:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841866.660334:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030e00, rc 0) 00000100:00100000:3.0:1787841866.660433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8131:x1874687858583936:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 221us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841866.660515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 217 00000100:00100000:2.0:1787841866.667649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841866.668019:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584064 00000100:00100000:3.0:1787841866.668037:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584064 00000100:00100000:3.0:1787841866.668144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 218 00000100:00100000:3.0:1787841866.668160:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8131:x1874687858584064:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787841866.668787:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8131:x1874687858584064:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 626us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841866.668798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 218 00000100:00100000:2.0:1787841866.670682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841866.676003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584192 00000100:00100000:0.0:1787841866.676029:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584192 00000100:00100000:0.0:1787841866.676138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 219 00000100:00100000:0.0:1787841866.676152:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8131:x1874687858584192:12345-192.168.202.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787841866.676556:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8131:x1874687858584192:12345-192.168.202.46@tcp:503:mount.lustre.0 Request processed in 404us (5886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.676565:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 219 00000100:00100000:2.0:1787841866.684731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841866.691854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584320 00000100:00100000:1.0:1787841866.691880:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584320 00000100:00100000:1.0:1787841866.691988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 220 00000100:00100000:1.0:1787841866.692002:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8137:x1874687858584320:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841866.693335:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8137:x1874687858584320:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 1318us (8655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841866.693353:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 220 00000100:00100000:2.0:1787841866.711147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841866.711278:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584448 00000100:00100000:0.0:1787841866.711293:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584448 00000100:00100000:0.0:1787841866.711369:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 221 00000100:00100000:0.0:1787841866.711382:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8137:x1874687858584448:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841866.711926:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:8137:x1874687858584448:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 544us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.711937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 221 00000100:00100000:2.0:1787841866.716897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841866.716952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841866.717066:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584576 00000100:00100000:3.0:1787841866.717091:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584576 00000100:00100000:3.0:1787841866.717161:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584704 00000100:00100000:3.0:1787841866.717165:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584704 00000100:00100000:3.0:1787841866.717234:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:3.0:1787841866.717249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a740780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858584704:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841866.717360:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a740780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858584704:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 115us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841866.717369:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:3.0:1787841866.717389:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:3.0:1787841866.717394:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1874687858584576:12345-192.168.202.46@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787841866.717422:0:5849:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 5092011a-795a-4dd0-a452-2a019c42720c@192.168.202.46@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1787841866.717528:0:5849:0:(genops.c:1385:class_connect()) connect: client 5092011a-795a-4dd0-a452-2a019c42720c, cookie 0x1d0ed3605e135f74 00000004:00100000:3.0:1787841866.717573:0:5849:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787841866.717956:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841866.724939:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9464b7fc7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841866.725248:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2345:x1874687858584576:12345-192.168.202.46@tcp:38:mount.lustre.0 Request processed in 7845us (8360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841866.725265:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:2.0:1787841866.732044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841866.732262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841866.738327:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584832 00000100:00100000:1.0:1787841866.738351:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584832 00000100:00100000:1.0:1787841866.738557:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858584960 00000100:00100000:1.0:1787841866.738562:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858584960 00000100:00100000:0.0:1787841866.739865:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:0.0:1787841866.739901:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+7:0:x1874687858584832:12345-192.168.202.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787841866.739983:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787841866.740169:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+7:0:x1874687858584832:12345-192.168.202.46@tcp:41:mount.lustre.0 Request processed in 284us (8146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.740179:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:0.0:1787841866.740221:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787841866.740230:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+6:8131:x1874687858584960:12345-192.168.202.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787841866.740269:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787841866.740295:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+6:8131:x1874687858584960:12345-192.168.202.46@tcp:41:mount.lustre.0 Request processed in 66us (8034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.740302:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00080000:2.0:1787841866.745671:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841866.748166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841866.748720:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585088 00000100:00100000:0.0:1787841866.748739:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585088 00000100:00100000:0.0:1787841866.748853:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:0.0:1787841866.748866:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+6:8131:x1874687858585088:12345-192.168.202.46@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787841866.749014:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+6:8131:x1874687858585088:12345-192.168.202.46@tcp:40:mount.lustre.0 Request processed in 149us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.749026:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:0.0:1787841866.752050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841866.752117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841866.752226:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585216 00000100:00100000:1.0:1787841866.752241:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585216 00000100:00100000:1.0:1787841866.752350:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:1.0:1787841866.752360:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874687858585216:12345-192.168.202.46@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787841866.752407:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5092011a-795a-4dd0-a452-2a019c42720c@192.168.202.46@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1787841866.752450:0:6694:0:(genops.c:1385:class_connect()) connect: client 5092011a-795a-4dd0-a452-2a019c42720c, cookie 0x1d0ed3605e135f7b 00002000:00100000:1.0:1787841866.752492:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5092011a-795a-4dd0-a452-2a019c42720c/ffff946487c57800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787841866.752531:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787841866.752929:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787841866.752980:0:6694:0:(import.c:65:import_set_state_nolock()) ffff946487c51000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841866.753171:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+6:2345:x1874687858585216:12345-192.168.202.46@tcp:8:mount.lustre.0 Request processed in 808us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841866.753182:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:2.0:1787841866.753287:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585472 00000100:00100000:2.0:1787841866.753293:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585472 00000100:00100000:2.0:1787841866.753345:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787841866.753355:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:8131:x1874687858585472:12345-192.168.202.46@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787841866.753627:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787841866.753760:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:8131:x1874687858585472:12345-192.168.202.46@tcp:33:mount.lustre.0 Request processed in 406us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841866.753769:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:0.0:1787841866.760884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841866.761234:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585344 00000100:00100000:1.0:1787841866.761249:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585344 00000100:00100000:1.0:1787841866.761310:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:1.0:1787841866.761321:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874687858585344:12345-192.168.202.46@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787841866.761367:0:6691:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5092011a-795a-4dd0-a452-2a019c42720c@192.168.202.46@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1787841866.761407:0:6691:0:(genops.c:1385:class_connect()) connect: client 5092011a-795a-4dd0-a452-2a019c42720c, cookie 0x1d0ed3605e135f82 00002000:00100000:1.0:1787841866.761427:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5092011a-795a-4dd0-a452-2a019c42720c/ffff946487c55800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787841866.761494:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787841866.761822:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787841866.761871:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9464c009d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841866.761967:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2345:x1874687858585344:12345-192.168.202.46@tcp:8:mount.lustre.0 Request processed in 645us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841866.761977:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00010000:00010000:1.0:1787841867.251657:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841868.279381:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841869.043600:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877493504:0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.043679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841869.043744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841869.043751:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877493632:0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.043778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841869.043825:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493504 00000100:00100000:0.0:1787841869.043833:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493504 00000100:00100000:0.0:1787841869.043893:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841869.043903:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877493504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.043960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877493504:12345-0@lo:400:kworker.0 Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841869.043981:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841869.044009:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493632 00000100:00100000:0.0:1787841869.044012:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493632 00000100:00100000:0.0:1787841869.044044:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841869.044067:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877493632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.044099:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877493632:12345-0@lo:400:kworker.0 Request processed in 35us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841869.044105:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787841869.044122:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841869.044126:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787841869.044162:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b7ed21c0 x1874687877493632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841869.044179:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877493632:0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.044194:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877493504:0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044329:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877493248:0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841869.044411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877493760:0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841869.044582:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787841869.044592:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877493376:0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841869.044637:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877493888:0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841869.044688:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493760 00000100:00100000:1.0:1787841869.044692:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493760 00000100:00100000:1.0:1787841869.044728:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493376 00000100:00100000:1.0:1787841869.044731:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493376 00000100:00100000:1.0:1787841869.044747:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841869.044754:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877493760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044791:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877493760:12345-0@lo:400:kworker.0 Request processed in 38us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841869.044798:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841869.044811:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787841869.044817:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877493376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044842:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877493376:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841869.044848:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787841869.044879:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877493376:0@lo:400:kworker.0 00000100:00100000:1.0:1787841869.044888:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877493760:0@lo:400:kworker.0 00000100:00100000:3.0:1787841869.045044:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493888 00000100:00100000:3.0:1787841869.045059:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493888 00000100:00100000:3.0:1787841869.045099:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787841869.045107:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877493888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841869.045148:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877493888:12345-0@lo:400:kworker.0 Request processed in 42us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841869.045154:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787841869.045180:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b7ed3840 x1874687877493888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841869.045191:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877493888:0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.045257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877493248 00000100:00100000:0.0:1787841869.045261:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877493248 00000100:00100000:0.0:1787841869.045304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787841869.045311:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841869.045349:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877493248:12345-0@lo:400:kworker.0 Request processed in 39us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841869.045356:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1787841869.045383:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841869.045387:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841869.045401:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877493248:0@lo:400:kworker.0 00010000:00010000:0.0:1787841869.297808:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841869.553710:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877494016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841869.553825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841869.553973:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494016 00000100:00100000:1.0:1787841869.553984:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494016 00000100:00100000:1.0:1787841869.554055:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787841869.554065:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877494016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841869.554105:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841869.554166:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877494016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841869.554174:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787841869.554211:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93fc00 x1874687877494016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841869.554229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877494016:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787841869.647003:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5092011a-795a-4dd0-a452-2a019c42720c 00000100:00100000:0.0:1787841870.067650:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841870.067676:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877494144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841870.067749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841870.067824:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494144 00000100:00100000:0.0:1787841870.067833:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494144 00000100:00100000:0.0:1787841870.067878:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841870.067888:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877494144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841870.067928:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841870.067973:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877494144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841870.067981:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787841870.068022:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b7ed0b40 x1874687877494144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841870.068055:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877494144:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787841870.191969:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5092011a-795a-4dd0-a452-2a019c42720c 00010000:00010000:0.0:1787841870.321874:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787841871.206436:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5092011a-795a-4dd0-a452-2a019c42720c 00010000:00010000:0.0:1787841871.348899:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841872.144517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841872.144561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841872.144590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841872.144617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841872.144743:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585728 00000100:00100000:0.0:1787841872.144753:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585728 00000100:00100000:0.0:1787841872.144818:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585856 00000100:00100000:0.0:1787841872.144821:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585856 00000100:00100000:0.0:1787841872.144847:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00100000:0.0:1787841872.144857:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858585728:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841872.144969:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858585728:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841872.144976:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00100000:0.0:1787841872.144998:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:0.0:1787841872.145035:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858585856:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841872.145063:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858585856:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841872.145070:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:0.0:1787841872.145092:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586112 00000100:00100000:0.0:1787841872.145095:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586112 00000100:00100000:0.0:1787841872.145126:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:0.0:1787841872.145132:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858586112:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841872.145160:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858586112:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841872.145166:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00080000:0.0:1787841872.145183:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841872.145189:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841872.146102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585600 00000100:00100000:3.0:1787841872.146110:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585600 00000100:00100000:3.0:1787841872.146158:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 223 00000100:00100000:3.0:1787841872.146166:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858585600:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841872.146224:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858585600:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 58us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841872.146231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 223 00000100:00100000:0.0:1787841872.147237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841872.147659:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858585984 00000100:00100000:1.0:1787841872.147667:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858585984 00000100:00100000:1.0:1787841872.147883:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:1.0:1787841872.147895:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858585984:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841872.147977:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858585984:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 85us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841872.147984:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00080000:0.0:1787841872.148838:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787841872.370064:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841873.393612:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841874.162222:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877494272:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.162310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.162366:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877494784:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.162395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.162422:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787841874.162428:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877494400:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.162452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.162548:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877494912:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.162877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.162938:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877494528:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.162969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.162990:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841874.163005:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877494656:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.163037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.163078:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494272 00000100:00100000:0.0:1787841874.163089:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494272 00000100:00100000:0.0:1787841874.163494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787841874.163506:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877494272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.163583:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877494272:12345-0@lo:400:kworker.0 Request processed in 80us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841874.163591:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787841874.167386:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877494272:0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.167687:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494912 00000100:00100000:2.0:1787841874.167696:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494912 00000100:00100000:2.0:1787841874.167794:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494656 00000100:00100000:2.0:1787841874.167797:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494656 00000100:00100000:2.0:1787841874.167829:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787841874.167838:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877494912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.167941:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877494912:12345-0@lo:400:kworker.0 Request processed in 104us (5063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841874.167949:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787841874.167965:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787841874.167972:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877494656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.168018:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877494656:12345-0@lo:400:kworker.0 Request processed in 47us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841874.168024:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787841874.168452:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494784 00000100:00100000:2.0:1787841874.168482:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494784 00000100:00100000:2.0:1787841874.168522:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494400 00000100:00100000:2.0:1787841874.168526:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494400 00000100:00100000:2.0:1787841874.168538:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877494528 00000100:00100000:2.0:1787841874.168540:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877494528 00000100:00100000:2.0:1787841874.168554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787841874.168560:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877494784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.168599:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877494784:12345-0@lo:400:kworker.0 Request processed in 39us (6203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841874.168606:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787841874.168618:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787841874.168624:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877494400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.168651:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877494400:12345-0@lo:400:kworker.0 Request processed in 28us (6199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841874.168657:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787841874.168667:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787841874.168683:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877494528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.168713:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877494528:12345-0@lo:400:kworker.0 Request processed in 31us (5743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841874.168719:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787841874.168786:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946493290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877494400:0@lo:400:kworker.0 00010000:00080000:2.0:1787841874.168803:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867af480 x1874687877494912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841874.168813:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877494912:0@lo:400:kworker.0 00000100:00100000:2.0:1787841874.168823:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877494784:0@lo:400:kworker.0 00000100:00080000:0.0:1787841874.170881:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841874.170893:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841874.170895:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787841874.170957:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867acf00 x1874687877494656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841874.170974:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877494656:0@lo:400:kworker.0 00000100:00100000:0.0:1787841874.170988:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877494528:0@lo:400:kworker.0 00000001:02000400:3.0:1787841874.318773:0:10316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787841874.418495:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841874.674178:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877495040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841874.674264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841874.674374:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495040 00000100:00100000:0.0:1787841874.674385:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495040 00000100:00100000:0.0:1787841874.674446:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841874.674485:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877495040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841874.674525:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841874.674581:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877495040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841874.674603:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787841874.675120:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93fc00 x1874687877495040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841874.675140:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877495040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841875.185875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877495168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841875.185971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841875.186090:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495168 00000100:00100000:0.0:1787841875.186099:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495168 00000100:00100000:0.0:1787841875.186152:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787841875.186163:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877495168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841875.186209:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841875.186273:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877495168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841875.186280:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787841875.186327:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b7ed30c0 x1874687877495168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841875.186346:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877495168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841875.441624:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841876.466615:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841877.271335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841877.271422:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841877.271474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841877.271494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841877.271516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841877.271539:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586752 00000100:00100000:1.0:1787841877.271546:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586752 00000100:00100000:3.0:1787841877.274030:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586496 00000100:00100000:3.0:1787841877.274048:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586496 00000100:00100000:3.0:1787841877.274129:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586368 00000100:00100000:3.0:1787841877.274133:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586368 00000100:00100000:3.0:1787841877.274167:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:3.0:1787841877.274177:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858586496:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841877.274281:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858586496:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 106us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841877.274289:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:3.0:1787841877.274309:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:3.0:1787841877.274317:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858586368:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841877.274343:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858586368:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841877.274349:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:1.0:1787841877.275752:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586624 00000100:00100000:1.0:1787841877.275763:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586624 00000100:00100000:1.0:1787841877.275795:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:1.0:1787841877.275805:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858586752:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841877.275870:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858586752:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 67us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841877.275878:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:1.0:1787841877.275894:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:1.0:1787841877.275899:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858586624:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841877.275918:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858586624:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 19us (4402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841877.275931:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00080000:1.0:1787841877.275964:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841877.276015:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841877.276018:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841877.279976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586240 00000100:00100000:0.0:1787841877.279992:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586240 00000100:00100000:0.0:1787841877.280079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 225 00000100:00100000:0.0:1787841877.280089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858586240:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841877.280171:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858586240:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 83us (8846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841877.280179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 225 00010000:00010000:0.0:1787841877.489882:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841878.513642:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841879.283015:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877495424:0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283116:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841879.283180:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9959680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877495936:0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283210:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841879.283245:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787841879.283252:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877495296:0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841879.283299:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877495808:0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841879.283357:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495424 00000100:00100000:1.0:1787841879.283366:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495424 00000100:00100000:1.0:1787841879.283418:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495808 00000100:00100000:1.0:1787841879.283421:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495808 00000100:00100000:1.0:1787841879.283492:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841879.283638:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877495424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283712:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877495424:12345-0@lo:400:kworker.0 Request processed in 212us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841879.283720:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841879.283741:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787841879.283747:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877495808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283770:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877495808:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841879.283784:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787841879.283802:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495936 00000100:00100000:1.0:1787841879.283806:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495936 00000100:00100000:1.0:1787841879.283830:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787841879.283836:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877495936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841879.283863:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877495936:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841879.283868:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787841879.283887:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841879.283892:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841879.284667:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877495808:0@lo:400:kworker.0 00000100:00100000:2.0:1787841879.284686:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877495424:0@lo:400:kworker.0 00010000:00080000:2.0:1787841879.284699:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9959680 x1874687877495936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841879.284709:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9959680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877495936:0@lo:400:kworker.0 00000100:00100000:0.0:1787841879.287721:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877495552:0@lo:400:kworker.0 00000100:00100000:0.0:1787841879.287796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841879.287851:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841879.287859:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877495680:0@lo:400:kworker.0 00000100:00100000:0.0:1787841879.287885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841879.287911:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495552 00000100:00100000:3.0:1787841879.287920:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495552 00000100:00100000:0.0:1787841879.287922:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495296 00000100:00100000:0.0:1787841879.287925:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495296 00000100:00100000:0.0:1787841879.287977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787841879.287981:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787841879.287985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877495296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841879.287987:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877495552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841879.288717:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877495680 00000100:00100000:2.0:1787841879.288724:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877495680 00000100:00100000:2.0:1787841879.288767:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787841879.288775:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877495680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841879.293075:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877495296:12345-0@lo:400:kworker.0 Request processed in 5077us (9781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841879.293095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787841879.293239:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877495552:12345-0@lo:400:kworker.0 Request processed in 5249us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841879.293240:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877495296:0@lo:400:kworker.0 00000100:00100000:3.0:1787841879.293250:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787841879.293283:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841879.293290:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841879.293297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877495552:0@lo:400:kworker.0 00000100:00100000:2.0:1787841879.294282:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877495680:12345-0@lo:400:kworker.0 Request processed in 5501us (6389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841879.294294:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787841879.294626:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b995a940 x1874687877495680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841879.294643:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877495680:0@lo:400:kworker.0 00010000:00010000:0.0:1787841879.545978:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841879.793679:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841879.793710:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877496064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841879.793787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841879.793922:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496064 00000100:00100000:1.0:1787841879.793933:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496064 00000100:00100000:1.0:1787841879.794012:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787841879.794026:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877496064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841879.794083:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841879.794149:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877496064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841879.794157:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787841879.794204:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b995a1c0 x1874687877496064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841879.794224:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877496064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841880.305924:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841880.305963:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877496192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841880.306081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841880.306189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496192 00000100:00100000:1.0:1787841880.306199:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496192 00000100:00100000:1.0:1787841880.306275:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787841880.306285:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877496192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841880.306320:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841880.306368:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877496192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841880.306375:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787841880.306428:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b995a1c0 x1874687877496192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841880.306447:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877496192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841880.566400:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841881.594167:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841882.388848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841882.388898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841882.388944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841882.388965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841882.388990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841882.389079:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858586880 00000100:00100000:1.0:1787841882.389089:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858586880 00000100:00100000:1.0:1787841882.389148:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 227 00000100:00100000:1.0:1787841882.389158:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858586880:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841882.389233:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858586880:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 77us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841882.389240:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 227 00000100:00100000:1.0:1787841882.389273:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587392 00000100:00100000:1.0:1787841882.389277:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587392 00000100:00100000:1.0:1787841882.389314:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587264 00000100:00100000:1.0:1787841882.389317:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587264 00000100:00100000:1.0:1787841882.389334:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:1.0:1787841882.389340:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858587392:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841882.389372:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858587392:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841882.389378:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:1.0:1787841882.389388:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:1.0:1787841882.389408:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858587264:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841882.389432:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858587264:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841882.389438:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:1.0:1787841882.389482:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587136 00000100:00100000:1.0:1787841882.389486:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587136 00000100:00100000:1.0:1787841882.389512:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587008 00000100:00100000:1.0:1787841882.389515:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587008 00000100:00100000:1.0:1787841882.389550:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:1.0:1787841882.389557:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858587136:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841882.389586:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858587136:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841882.389592:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:1.0:1787841882.389603:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00100000:1.0:1787841882.389608:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858587008:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841882.389626:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858587008:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 19us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841882.389632:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00080000:1.0:1787841882.389780:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841882.389784:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841882.389786:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787841882.611861:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841883.633805:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841884.408746:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877496576:0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.408824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841884.408919:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841884.408928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877496320:0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.408934:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877496704:0@lo:400:kworker.0 00000100:00100000:0.0:1787841884.409013:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877496448:0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.409213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841884.409254:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496576 00000100:00100000:2.0:1787841884.409262:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496576 00000100:00100000:2.0:1787841884.409323:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787841884.409335:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877496576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.409400:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877496576:12345-0@lo:400:kworker.0 Request processed in 68us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841884.409408:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787841884.409432:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496704 00000100:00100000:2.0:1787841884.409435:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496704 00000100:00100000:2.0:1787841884.409508:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787841884.409516:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877496704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.409548:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877496704:12345-0@lo:400:kworker.0 Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841884.409555:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787841884.409571:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841884.409576:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787841884.409611:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ade00 x1874687877496704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841884.409625:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877496704:0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.409637:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877496576:0@lo:400:kworker.0 00000100:00100000:3.0:1787841884.412728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841884.412825:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877496832:0@lo:400:kworker.0 00000100:00100000:3.0:1787841884.412895:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841884.412966:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496832 00000100:00100000:3.0:1787841884.412973:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496832 00000100:00100000:3.0:1787841884.413447:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787841884.413484:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877496832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841884.413562:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877496832:12345-0@lo:400:kworker.0 Request processed in 107us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841884.413570:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787841884.413616:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877496832:0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.414170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496320 00000100:00100000:2.0:1787841884.414176:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496320 00000100:00100000:2.0:1787841884.414216:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787841884.414224:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877496320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.414299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877496320:12345-0@lo:400:kworker.0 Request processed in 65us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841884.414307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:2.0:1787841884.414343:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841884.414365:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877496320:0@lo:400:kworker.0 00000100:00100000:1.0:1787841884.415747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841884.415788:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877496960:0@lo:400:kworker.0 00000100:00100000:1.0:1787841884.415831:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841884.416243:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496448 00000100:00100000:2.0:1787841884.416253:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496448 00000100:00100000:2.0:1787841884.416307:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787841884.416318:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877496448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841884.416376:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877496448:12345-0@lo:400:kworker.0 Request processed in 60us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841884.416383:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787841884.416426:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877496448:0@lo:400:kworker.0 00000100:00100000:0.0:1787841884.416650:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877496960 00000100:00100000:0.0:1787841884.416655:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877496960 00000100:00100000:0.0:1787841884.416697:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787841884.416712:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877496960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841884.416754:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877496960:12345-0@lo:400:kworker.0 Request processed in 43us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841884.416761:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787841884.416779:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787841884.418201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ae940 x1874687877496960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841884.418219:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877496960:0@lo:400:kworker.0 00010000:00010000:0.0:1787841884.657774:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841884.915339:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841884.915368:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9955680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877497088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841884.915483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841884.917495:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497088 00000100:00100000:3.0:1787841884.918610:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497088 00000100:00100000:3.0:1787841884.918690:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787841884.918702:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877497088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841884.918750:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841884.918852:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877497088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841884.918876:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787841884.921610:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9955680 x1874687877497088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841884.921643:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9955680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877497088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841885.430367:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841885.430391:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877497216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841885.430482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841885.430593:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497216 00000100:00100000:0.0:1787841885.430600:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497216 00000100:00100000:0.0:1787841885.430660:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787841885.430669:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877497216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841885.430706:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841885.430751:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877497216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841885.430758:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787841885.431098:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867af480 x1874687877497216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841885.431642:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877497216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841885.685594:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841886.709056:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841887.508054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841887.508105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841887.508231:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587520 00000100:00100000:3.0:1787841887.508241:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587520 00000100:00100000:3.0:1787841887.508313:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 229 00000100:00100000:3.0:1787841887.508326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858587520:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841887.508443:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858587520:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 118us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841887.508451:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 229 00000100:00100000:0.0:1787841887.509994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841887.515658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841887.515710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841887.515763:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587904 00000100:00100000:0.0:1787841887.515790:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587904 00000100:00100000:0.0:1787841887.515865:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588032 00000100:00100000:0.0:1787841887.515878:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588032 00000100:00100000:0.0:1787841887.515903:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:0.0:1787841887.515913:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2345:x1874687858587904:12345-192.168.202.46@tcp:9:kworker.0 00000020:00000080:0.0:1787841887.515960:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135f7b 00000100:00080000:0.0:1787841887.515972:0:6694:0:(import.c:65:import_set_state_nolock()) ffff946487c51000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841887.516025:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787841887.516540:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+2:2345:x1874687858587904:12345-192.168.202.46@tcp:9:kworker.0 Request processed in 625us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841887.516550:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:0.0:1787841887.516571:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787841887.516579:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2345:x1874687858588032:12345-192.168.202.46@tcp:9:kworker.0 00000020:00000080:0.0:1787841887.516595:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135f82 00000100:00080000:0.0:1787841887.516602:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9464c009d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841887.516628:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787841887.516827:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5092011a-795a-4dd0-a452-2a019c42720c+2:2345:x1874687858588032:12345-192.168.202.46@tcp:9:kworker.0 Request processed in 248us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841887.516834:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00080000:0.0:1787841887.516855:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841887.516859:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787841887.516887:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841887.516894:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841887.521585:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587776 00000100:00100000:1.0:1787841887.521602:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587776 00000100:00100000:1.0:1787841887.521748:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858587648 00000100:00100000:1.0:1787841887.521752:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858587648 00000100:00100000:1.0:1787841887.521801:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:1.0:1787841887.521812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858587776:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841887.521946:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858587776:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 135us (13840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841887.521954:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:1.0:1787841887.521978:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00100000:1.0:1787841887.521986:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858587648:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841887.522012:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858587648:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (12029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841887.522018:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00080000:0.0:1787841887.522326:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787841887.738047:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841888.754865:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841889.521788:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841889.521905:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841889.521926:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877497472:0@lo:400:kworker.0 00000100:00100000:2.0:1787841889.521997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841889.522058:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497472 00000100:00100000:2.0:1787841889.522065:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497472 00000100:00100000:2.0:1787841889.522117:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787841889.522127:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877497472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841889.522186:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877497472:12345-0@lo:400:kworker.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841889.522210:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787841889.522259:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877497472:0@lo:400:kworker.0 00000100:00100000:1.0:1787841889.524408:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877497344:0@lo:400:kworker.0 00000100:00100000:1.0:1787841889.524520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841889.524695:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497344 00000100:00100000:2.0:1787841889.524706:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497344 00000100:00100000:2.0:1787841889.524756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787841889.524765:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877497344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841889.524831:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3309:x1874687877497344:12345-0@lo:400:kworker.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841889.524839:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787841889.524901:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877497344:0@lo:400:kworker.0 00000100:00100000:0.0:1787841889.526553:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464903e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877497600:0@lo:400:kworker.0 00000100:00100000:0.0:1787841889.526611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841889.526650:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841889.526656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877497728:0@lo:400:kworker.0 00000100:00100000:0.0:1787841889.526679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841889.526707:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497600 00000100:00100000:0.0:1787841889.526713:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497600 00000100:00100000:0.0:1787841889.526759:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787841889.526768:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841889.526914:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877497856:0@lo:400:kworker.0 00000100:00100000:3.0:1787841889.526940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841889.526957:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841889.526961:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877497984:0@lo:400:kworker.0 00000100:00100000:3.0:1787841889.526977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841889.527002:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497728 00000100:00100000:3.0:1787841889.527005:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497728 00000100:00100000:3.0:1787841889.527028:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497984 00000100:00100000:3.0:1787841889.527030:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497984 00000100:00100000:3.0:1787841889.527042:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787841889.527048:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841889.527098:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877497728:12345-0@lo:400:kworker.0 Request processed in 50us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841889.527105:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787841889.527126:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787841889.527131:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877497984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841889.527157:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877497984:12345-0@lo:400:kworker.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841889.527173:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787841889.527205:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648847e1c0 x1874687877497728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841889.527219:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877497728:0@lo:400:kworker.0 00010000:00080000:3.0:1787841889.527405:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648847f840 x1874687877497984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841889.527414:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877497984:0@lo:400:kworker.0 00000100:00100000:0.0:1787841889.527489:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877497600:12345-0@lo:400:kworker.0 Request processed in 722us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841889.527495:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787841889.527507:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877497856 00000100:00100000:0.0:1787841889.527509:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877497856 00000100:00100000:0.0:1787841889.527528:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787841889.527533:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877497856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841889.527560:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877497856:12345-0@lo:400:kworker.0 Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841889.527565:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787841889.527584:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841889.527588:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841889.527591:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841889.527711:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464903e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877497600:0@lo:400:kworker.0 00000100:00100000:3.0:1787841889.527731:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877497856:0@lo:400:kworker.0 00010000:00010000:0.0:1787841889.781003:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841890.033826:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877498112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841890.033929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841890.034373:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498112 00000100:00100000:3.0:1787841890.034382:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498112 00000100:00100000:3.0:1787841890.034436:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787841890.034445:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877498112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841890.034499:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841890.034548:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877498112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841890.034556:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787841890.034620:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9954b40 x1874687877498112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841890.034639:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877498112:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787841890.097491:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5092011a-795a-4dd0-a452-2a019c42720c 00000020:00000080:0.0:1787841890.097506:0:6718:0:(genops.c:885:class_export_put()) final put ffff946487c57800/5092011a-795a-4dd0-a452-2a019c42720c 00000020:00000080:0.0:1787841890.097538:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946487c57800/5092011a-795a-4dd0-a452-2a019c42720c for lustre-OST0000 00000020:00000080:0.0:1787841890.097581:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946487c51000 for lustre-OST0000 00000100:00100000:0.0:1787841890.555655:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841890.555693:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877498240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841890.555769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841890.559189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498240 00000100:00100000:2.0:1787841890.559210:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498240 00000100:00100000:2.0:1787841890.559283:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787841890.559294:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877498240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841890.559337:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841890.559440:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877498240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841890.559447:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787841890.564823:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867af840 x1874687877498240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841890.564864:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877498240:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787841890.648397:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5092011a-795a-4dd0-a452-2a019c42720c 00000020:00000080:1.0:1787841890.648408:0:7646:0:(genops.c:885:class_export_put()) final put ffff946487c55800/5092011a-795a-4dd0-a452-2a019c42720c 00000020:00000080:1.0:1787841890.648435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946487c55800/5092011a-795a-4dd0-a452-2a019c42720c for lustre-OST0001 00000020:00000080:1.0:1787841890.648684:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464c009d000 for lustre-OST0001 00010000:00010000:0.0:1787841890.808923:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841891.830200:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841892.627680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841892.627728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841892.627766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841892.627875:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588416 00000100:00100000:3.0:1787841892.627886:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588416 00000100:00100000:3.0:1787841892.627962:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588288 00000100:00100000:3.0:1787841892.627965:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588288 00000100:00100000:1.0:1787841892.628021:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 91 00000100:00100000:3.0:1787841892.628039:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:1.0:1787841892.628039:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858588416:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841892.628053:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858588288:12345-192.168.202.46@tcp:400:kworker.0 00000100:00080000:0.0:1787841892.628140:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841892.628361:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858588288:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 310us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841892.628370:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:2.0:1787841892.628509:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588160 00000100:00100000:2.0:1787841892.628514:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588160 00000100:00100000:2.0:1787841892.628551:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 231 00000100:00100000:2.0:1787841892.628559:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858588160:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841892.628628:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858588416:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 594us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841892.628643:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 91 00000100:00100000:2.0:1787841892.633834:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858588160:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 5231us (6124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841892.633865:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 231 00010000:00010000:0.0:1787841892.852735:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841893.542727:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787841893.874070:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841894.641936:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9954780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877498752:0@lo:400:kworker.0 00000100:00100000:2.0:1787841894.642053:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877498368:0@lo:400:kworker.0 00000100:00100000:3.0:1787841894.642059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841894.642186:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877498496:0@lo:400:kworker.0 00000100:00100000:0.0:1787841894.645195:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841894.645286:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877499008:0@lo:400:kworker.0 00000100:00100000:0.0:1787841894.645337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841894.645427:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877498624:0@lo:400:kworker.0 00000100:00100000:0.0:1787841894.645497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841894.645750:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498496 00000100:00100000:0.0:1787841894.645759:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498496 00000100:00100000:0.0:1787841894.645824:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498624 00000100:00100000:0.0:1787841894.645828:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498624 00000100:00100000:0.0:1787841894.645872:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787841894.645890:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877498496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841894.645921:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787841894.645934:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877498624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841894.645958:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877498496:12345-0@lo:400:kworker.0 Request processed in 69us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841894.645967:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787841894.645989:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877498624:12345-0@lo:400:kworker.0 Request processed in 57us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841894.645997:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787841894.645998:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841894.646036:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877498624:0@lo:400:kworker.0 00000100:00100000:0.0:1787841894.646037:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877498496:0@lo:400:kworker.0 00000100:00100000:2.0:1787841894.646818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841894.646897:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877498880:0@lo:400:kworker.0 00000100:00100000:2.0:1787841894.646930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841894.646968:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498880 00000100:00100000:2.0:1787841894.646974:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498880 00000100:00100000:2.0:1787841894.647019:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787841894.647026:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877498880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841894.647069:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877498880:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841894.647077:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787841894.647102:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841894.647130:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877498880:0@lo:400:kworker.0 00000100:00100000:3.0:1787841894.647246:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498752 00000100:00100000:3.0:1787841894.647252:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498752 00000100:00100000:3.0:1787841894.647296:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499008 00000100:00100000:3.0:1787841894.647300:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499008 00000100:00100000:3.0:1787841894.647321:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787841894.647329:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877498752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841894.647374:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877498752:12345-0@lo:400:kworker.0 Request processed in 47us (5318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841894.647382:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787841894.647400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787841894.647409:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877499008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841894.647442:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877499008:12345-0@lo:400:kworker.0 Request processed in 36us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841894.647448:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787841894.647546:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b99543c0 x1874687877499008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841894.647559:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877499008:0@lo:400:kworker.0 00010000:00080000:3.0:1787841894.647606:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9954780 x1874687877498752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841894.647624:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9954780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877498752:0@lo:400:kworker.0 00000100:00080000:2.0:1787841894.648048:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841894.648052:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841894.648423:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877498368 00000100:00100000:0.0:1787841894.648429:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877498368 00000100:00100000:3.0:1787841894.648835:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787841894.648846:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877498368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841894.648917:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877498368:12345-0@lo:400:kworker.0 Request processed in 70us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841894.648923:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787841894.648955:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877498368:0@lo:400:kworker.0 00010000:00010000:0.0:1787841894.897745:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841895.155751:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877499136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841895.155842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841895.155920:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499136 00000100:00100000:2.0:1787841895.155929:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499136 00000100:00100000:2.0:1787841895.155978:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787841895.155987:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877499136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841895.156022:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841895.156066:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877499136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841895.156074:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787841895.156133:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867af840 x1874687877499136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841895.156149:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877499136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841895.665969:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841895.666000:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877499264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841895.666085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841895.666218:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499264 00000100:00100000:2.0:1787841895.666226:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499264 00000100:00100000:2.0:1787841895.666281:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787841895.666291:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877499264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841895.666334:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841895.666393:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877499264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841895.666410:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787841895.666837:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464867ac780 x1874687877499264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841895.666861:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877499264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841895.921746:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841896.951813:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787841897.073081:0:11169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6a9574d0 20000000:00000080:1.0:1787841897.073104:0:11169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94638121cc00 uarg=0000000000000000 20000000:01000000:1.0:1787841897.074332:0:11169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787841897.074340:0:11169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787841897.074346:0:11169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787841897.079697:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787841897.081611:0:11169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787841897.090447:0:11169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787841897.090666:0:11169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090690:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090700:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090706:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090712:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090739:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090746:0:11169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090809:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090826:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 12 pid: 5844 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.090841:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499392:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841897.090953:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.090962:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 18 pid: 5842 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.090971:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99583c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499520:0@lo:104: 00000100:00100000:1.0:1787841897.091017:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841897.091055:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.091063:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 18 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.091071:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9959a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499648:0@lo:104: 00000100:00100000:1.0:1787841897.091103:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841897.091130:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841897.091606:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499520 00000100:00100000:3.0:1787841897.091614:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499520 00000100:00100000:3.0:1787841897.091665:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499648 00000100:00100000:3.0:1787841897.091668:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499648 00000100:00100000:3.0:1787841897.091683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841897.091692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:11169:x1874687877499520:12345-0@lo:104: 00010000:00010000:3.0:1787841897.091705:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841897.091756:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787841897.091761:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:11169:x1874687877499520:12345-0@lo:104: Request processed in 71us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841897.091768:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841897.091801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841897.091809:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:11169:x1874687877499648:12345-0@lo:104: 00010000:00010000:3.0:1787841897.091817:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841897.091846:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787841897.091850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:11169:x1874687877499648:12345-0@lo:104: Request processed in 43us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841897.091864:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787841897.091944:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 18 pid: 5841 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.091959:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499776:0@lo:104: 00010000:00010000:0.0:1787841897.092036:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787841897.092044:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092052:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841897.092056:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092064:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841897.092082:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841897.092088:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841897.092120:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092126:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841897.092166:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092173:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946480030200/0x1d0ed3605e135f51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f58 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092187:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841897.092190:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092194:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841897.092197:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092203:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841897.092208:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841897.092213:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841897.092233:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092239:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841897.092245:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092251:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f4a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092261:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841897.092262:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841897.092264:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841897.092271:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841897.092322:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841897.092360:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.092371:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841897.092380:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877500160:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841897.092838:0:11169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841897.092865:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99583c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499520:0@lo:104: 00000100:00100000:0.0:1787841897.092878:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9959a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499648:0@lo:104: 00000100:00100000:0.0:1787841897.092907:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499776 00000100:00100000:0.0:1787841897.092912:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499776 00000100:00100000:0.0:1787841897.092939:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841897.092947:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:11169:x1874687877499776:12345-0@lo:104: 00010000:00010000:0.0:1787841897.092957:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.093010:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841897.093016:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:907da169-f099-4269-9458-b15bc87a550d+3:11169:x1874687877499776:12345-0@lo:104: Request processed in 70us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841897.093022:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787841897.093040:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841897.093045:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.093051:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841897.093055:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.093063:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841897.093070:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841897.093075:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841897.093092:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.093097:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841897.093114:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.093121:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481498c00/0x1d0ed3605e135f35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135f3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.093863:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841897.093867:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841897.093869:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841897.093887:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877500288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841897.093942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841897.093980:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500288 00000100:00100000:0.0:1787841897.093985:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500288 00010000:00010000:0.0:1787841897.094009:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 19 pid: 5841 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841897.094043:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841897.094051:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648709c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877500288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841897.094064:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841897.094070:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 19 pid: 5841 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.094081:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 19 pid: 5841 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.094098:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841897.094128:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648709c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877500288:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841897.094134:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841897.094290:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877500288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841897.094318:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481498200/0x1d0ed3605e135f3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135f35 expref: 18 pid: 5841 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841897.094342:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499776:0@lo:104: 00000100:00100000:1.0:1787841897.094663:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877499904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841897.094693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841897.094719:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841897.094725:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877500032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841897.094746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841897.094769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877499904 00000100:00100000:1.0:1787841897.094786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877499904 00010000:00010000:1.0:1787841897.094805:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 18 pid: 5842 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.094821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500032 00000100:00100000:1.0:1787841897.094824:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500032 00010000:00010000:1.0:1787841897.094833:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 19 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.094844:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787841897.094849:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877499904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841897.094857:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841897.094861:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 19 pid: 5842 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.094879:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 19 pid: 5842 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.094899:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6dee00/0x1d0ed3605e135f58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135f51 expref: 19 pid: 5842 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.094908:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841897.094936:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+18:3308:x1874687877499904:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841897.094942:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787841897.094955:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787841897.094961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9959680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+17:3308:x1874687877500032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841897.094969:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841897.094973:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 17 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.094981:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 17 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.094991:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e135f4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135f43 expref: 17 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.094999:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841897.095019:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9959680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877500032:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841897.095025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787841897.095051:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877500032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841897.095058:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877499904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841897.097976:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877499392:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841897.097990:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1874687877500160:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841897.098026:0:11169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841897.098823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841897.098889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588544 00000100:00100000:1.0:1787841897.098897:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588544 00010000:00010000:1.0:1787841897.098932:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 13 pid: 5844 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841897.098973:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 28 00000100:00100000:1.0:1787841897.098982:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858588544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841897.098998:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841897.099004:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 13 pid: 5844 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.099016:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 13 pid: 5844 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.099035:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030e00/0x1d0ed3605e135f6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979d5 expref: 13 pid: 5844 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841897.099050:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841897.099107:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:2349:x1874687858588544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841897.099115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 28 00000100:00100000:3.0:1787841897.100249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841897.100383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588672 00000100:00100000:0.0:1787841897.100399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588672 00010000:00010000:0.0:1787841897.100427:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841897.100481:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:0.0:1787841897.100490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9954780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:2349:x1874687858588672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841897.100502:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841897.100506:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100516:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100530:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2044400/0x1d0ed3605e135f2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d9799d expref: 12 pid: 5842 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100544:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100572:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100587:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100594:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100601:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100607:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100613:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247c00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841897.100618:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100627:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100645:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841897.100655:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841897.100702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9954780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2349:x1874687858588672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 213us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841897.100709:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 29 00010000:00010000:2.0:1787841897.100810:0:11169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841897.100818:0:11169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841897.100824:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e135f89 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841897.746270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841897.746338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841897.746392:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841897.746523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588800 00000100:00100000:0.0:1787841897.746555:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588800 00000100:00100000:0.0:1787841897.746631:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 233 00000100:00100000:0.0:1787841897.746644:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2347:x1874687858588800:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841897.746736:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2347:x1874687858588800:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 95us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841897.746744:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 233 00000100:00100000:1.0:1787841897.746928:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589056 00000100:00100000:1.0:1787841897.746933:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589056 00000100:00100000:3.0:1787841897.746963:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858588928 00000100:00100000:3.0:1787841897.746967:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858588928 00000100:00100000:1.0:1787841897.746986:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00100000:3.0:1787841897.746992:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:1.0:1787841897.746994:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858589056:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841897.746997:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858588928:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841897.747036:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858589056:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 42us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841897.747043:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00080000:0.0:1787841897.747124:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841897.749806:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858588928:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 2793us (3398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841897.749821:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 97 00010000:00010000:0.0:1787841897.969844:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841898.340893:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841898.342332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589184 00000100:00100000:1.0:1787841898.342346:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589184 00000100:00100000:1.0:1787841898.342415:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 234 00000100:00100000:1.0:1787841898.342426:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:5589:x1874687858589184:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841898.342444:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841898.342495:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d979ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.342525:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.342535:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.342544:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247a00, rc 0) 00000100:00100000:1.0:1787841898.342606:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858589184:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 183us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.342612:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 234 00000100:00100000:1.0:1787841898.347625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841898.347775:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589312 00000100:00100000:2.0:1787841898.347797:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589312 00000100:00100000:2.0:1787841898.347876:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 235 00000100:00100000:2.0:1787841898.347889:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858589312:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841898.348259:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858589312:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 370us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841898.348268:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 235 00000100:00100000:3.0:1787841898.353392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841898.358255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589440 00000100:00100000:0.0:1787841898.358271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589440 00000100:00100000:0.0:1787841898.358363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 236 00000100:00100000:0.0:1787841898.358386:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858589440:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841898.359100:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858589440:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 725us (5734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841898.359109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 236 00000100:00100000:0.0:1787841898.385549:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841898.388422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589568 00000100:00100000:1.0:1787841898.388439:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589568 00000100:00100000:1.0:1787841898.388539:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 237 00000100:00100000:1.0:1787841898.388549:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858589568:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841898.388568:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841898.388586:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.388616:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.388642:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.388664:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247000, rc 0) 00000100:00100000:1.0:1787841898.388735:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858589568:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 187us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.388742:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 237 00000100:00100000:1.0:1787841898.396664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841898.396826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589696 00000100:00100000:0.0:1787841898.396838:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589696 00000100:00100000:0.0:1787841898.396932:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 238 00000100:00100000:0.0:1787841898.396944:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858589696:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841898.397304:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858589696:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 362us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841898.397313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 238 00000100:00100000:3.0:1787841898.412362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841898.412508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589824 00000100:00100000:1.0:1787841898.412520:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589824 00000100:00100000:1.0:1787841898.412580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 239 00000100:00100000:1.0:1787841898.412589:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858589824:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.412838:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858589824:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 250us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.412845:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 239 10000000:01000000:0.0:1787841898.560363:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841898.560383:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464c1af7000 from 7 10000000:01000000:0.0:1787841898.560389:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841898.560622:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841898.560639:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841898.560659:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841898.560697:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841898.561163:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841898.561284:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841898.570630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500416 00000100:00100000:3.0:1787841898.570653:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500416 00000100:00100000:3.0:1787841898.570748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787841898.570787:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877500416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841898.570811:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841898.570835:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135f9e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.570872:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.570969:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.570984:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031000, rc 0) 00000100:00100000:3.0:1787841898.571119:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877500416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 361us (9957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841898.571147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787841898.571752:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841898.571802:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841898.571814:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841898.572042:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841898.572101:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841898.572153:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648672e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.572204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500544 00000100:00100000:1.0:1787841898.572212:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500544 00000100:00100000:1.0:1787841898.572260:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787841898.572269:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877500544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.572693:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877500544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.572702:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787841898.573670:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841898.573739:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841898.573823:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841898.573845:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648672e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841898.574110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500672 00000100:00100000:3.0:1787841898.574117:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500672 00000100:00100000:3.0:1787841898.574171:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787841898.574181:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877500672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841898.574411:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877500672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841898.574418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787841898.575843:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787841898.587900:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787841898.588214:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787841898.588243:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841898.588257:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.588269:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841898.588280:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841898.588283:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946486706000 from 7 10000000:01000000:3.0:1787841898.588286:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841898.588323:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.588332:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.588345:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841898.588377:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841898.588507:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841898.588546:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e4240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.588629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500800 00000100:00100000:1.0:1787841898.588637:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500800 00000100:00100000:1.0:1787841898.588703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787841898.588721:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877500800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841898.588737:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841898.588751:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135fac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.588791:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.588803:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.588813:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246000, rc 0) 00000100:00100000:1.0:1787841898.588868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877500800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.588889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787841898.588950:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841898.588965:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.588973:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841898.589036:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.589065:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841898.589089:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.589103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877500928 00000100:00100000:1.0:1787841898.589106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877500928 00000100:00100000:1.0:1787841898.589127:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787841898.589140:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877500928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.589449:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877500928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.589500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787841898.589532:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877500928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.589565:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.589601:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841898.589615:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.589626:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501056 00000100:00100000:1.0:1787841898.589629:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501056 00000100:00100000:1.0:1787841898.589647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787841898.589653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877501056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.589807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877501056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.589815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787841898.589852:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787841898.590559:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787841898.590607:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787841898.590628:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841898.590638:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.590648:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841898.590657:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787841898.590667:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946485cca000 from 7 10000000:01000000:1.0:1787841898.590670:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841898.590691:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.590698:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.590706:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841898.590719:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.590749:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841898.590780:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464851370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.590794:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501184 00000100:00100000:1.0:1787841898.590813:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501184 00000100:00100000:1.0:1787841898.590840:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787841898.590847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877501184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841898.590856:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841898.590869:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e135fba expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.590895:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.590906:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.590915:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247200, rc 0) 00000100:00100000:1.0:1787841898.590945:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877501184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.590957:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787841898.590993:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841898.591008:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841898.591017:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841898.591060:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.591083:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841898.591096:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464851370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.591106:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501312 00000100:00100000:1.0:1787841898.591109:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501312 00000100:00100000:1.0:1787841898.591127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787841898.591133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877501312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.591354:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877501312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.591361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787841898.591389:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.591411:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.591447:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841898.591485:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464851370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841898.591497:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501440 00000100:00100000:1.0:1787841898.591500:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501440 00000100:00100000:1.0:1787841898.591521:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787841898.591533:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877501440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841898.591678:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877501440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841898.591684:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787841898.591718:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9958f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877501440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787841898.627108:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787841898.627408:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787841898.627428:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841898.627440:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841898.627452:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841898.993956:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841899.762154:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877501568:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762226:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841899.762287:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877502080:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841899.762342:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841899.762348:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877501952:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841899.762402:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877501824:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841899.762477:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787841899.762482:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877501696:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841899.762521:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877502208:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841899.762573:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501952 00000100:00100000:3.0:1787841899.762581:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501952 00000100:00100000:3.0:1787841899.762716:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502208 00000100:00100000:3.0:1787841899.762733:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502208 00000100:00100000:3.0:1787841899.762770:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787841899.762780:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877501952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762844:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877501952:12345-0@lo:400:kworker.0 Request processed in 67us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841899.762852:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787841899.762870:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841899.762877:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9957840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877502208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.762906:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9957840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877502208:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841899.762912:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841899.762930:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502080 00000100:00100000:3.0:1787841899.762933:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502080 00000100:00100000:3.0:1787841899.762958:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501824 00000100:00100000:3.0:1787841899.762960:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501824 00000100:00100000:3.0:1787841899.762971:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501696 00000100:00100000:3.0:1787841899.762973:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501696 00000100:00100000:3.0:1787841899.762986:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787841899.762992:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877502080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.763023:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877502080:12345-0@lo:400:kworker.0 Request processed in 31us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841899.763029:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787841899.763041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787841899.763046:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877501824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.763071:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877501824:12345-0@lo:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841899.763077:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787841899.763095:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787841899.763101:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877501696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.763130:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877501696:12345-0@lo:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841899.763136:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1787841899.763158:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841899.763163:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841899.763164:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841899.763198:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877501696:0@lo:400:kworker.0 00010000:00080000:3.0:1787841899.763211:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e8b40 x1874687877502208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841899.763221:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877502208:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.763229:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877501824:0@lo:400:kworker.0 00010000:00080000:3.0:1787841899.763264:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf93c000 x1874687877501952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841899.763273:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877501952:0@lo:400:kworker.0 00000100:00100000:3.0:1787841899.763283:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877502080:0@lo:400:kworker.0 00000100:00100000:2.0:1787841899.763584:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877501568 00000100:00100000:2.0:1787841899.763589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877501568 00000100:00100000:1.0:1787841899.763711:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787841899.763719:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877501568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841899.763776:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877501568:12345-0@lo:400:kworker.0 Request processed in 58us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841899.763783:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787841899.764698:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877501568:0@lo:400:kworker.0 00010000:00010000:0.0:1787841900.020595:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841900.278187:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841900.278259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841900.278385:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502336 00000100:00100000:3.0:1787841900.278392:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502336 00000100:00100000:3.0:1787841900.278448:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787841900.278475:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877502336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841900.278510:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841900.278556:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877502336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841900.278571:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787841900.278614:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9955a40 x1874687877502336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841900.278632:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841900.786606:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877502464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841900.786701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841900.788362:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502464 00000100:00100000:2.0:1787841900.788374:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502464 00000100:00100000:2.0:1787841900.788435:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787841900.788446:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877502464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841900.788511:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841900.788608:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877502464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841900.788616:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787841900.788675:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e8780 x1874687877502464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841900.788695:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877502464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841901.047764:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841902.066760:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841902.876728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841902.876850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841902.876968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841902.877009:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590080 00000100:00100000:1.0:1787841902.877020:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590080 00000100:00100000:1.0:1787841902.877263:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590208 00000100:00100000:1.0:1787841902.877267:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590208 00000100:00100000:1.0:1787841902.877293:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:1.0:1787841902.877304:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858590080:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841902.877406:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858590080:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 104us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841902.877413:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:1.0:1787841902.877434:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 102 00000100:00100000:1.0:1787841902.877441:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858590208:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841902.877503:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858590208:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 62us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841902.877509:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 102 00000100:00080000:1.0:1787841902.877526:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841902.889682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858589952 00000100:00100000:0.0:1787841902.889701:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858589952 00000100:00100000:1.0:1787841902.890000:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 250 00000100:00100000:1.0:1787841902.890012:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858589952:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841902.890133:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858589952:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 121us (13282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841902.890141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 250 00010000:00010000:1.0:1787841903.102671:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841904.116618:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841904.175318:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787841904.881788:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877502848:0@lo:400:kworker.0 00000100:00100000:2.0:1787841904.881861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841904.881924:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787841904.881930:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877502720:0@lo:400:kworker.0 00000100:00100000:2.0:1787841904.881951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841904.881978:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877503232:0@lo:400:kworker.0 00000100:00100000:2.0:1787841904.882000:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841904.882028:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502848 00000100:00100000:2.0:1787841904.882033:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502848 00000100:00100000:1.0:1787841904.882190:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502720 00000100:00100000:1.0:1787841904.882195:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502720 00000100:00100000:1.0:1787841904.882223:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787841904.882232:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841904.882284:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877502848:12345-0@lo:400:kworker.0 Request processed in 53us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841904.882291:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787841904.882308:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787841904.882313:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877502720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841904.882334:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877502720:12345-0@lo:400:kworker.0 Request processed in 21us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841904.882339:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787841904.882376:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877502720:0@lo:400:kworker.0 00000100:00100000:1.0:1787841904.882385:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877502848:0@lo:400:kworker.0 00000100:00080000:1.0:1787841904.882446:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841904.882493:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503232 00000100:00100000:1.0:1787841904.882497:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503232 00000100:00100000:1.0:1787841904.882527:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787841904.882533:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877503232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841904.882567:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877503232:12345-0@lo:400:kworker.0 Request processed in 35us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841904.882573:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787841904.882587:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787841904.882616:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfbcd680 x1874687877503232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841904.882627:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877503232:0@lo:400:kworker.0 00000100:00100000:0.0:1787841904.882991:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877502976:0@lo:400:kworker.0 00000100:00100000:0.0:1787841904.883022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841904.883067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787841904.883073:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877502592:0@lo:400:kworker.0 00000100:00100000:0.0:1787841904.883110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841904.883138:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877503104:0@lo:400:kworker.0 00000100:00100000:0.0:1787841904.883169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841904.883194:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503104 00000100:00100000:0.0:1787841904.883198:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503104 00000100:00100000:0.0:1787841904.883230:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787841904.883236:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877503104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841904.883267:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877503104:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841904.883273:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1787841904.883290:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841904.883308:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877503104:0@lo:400:kworker.0 00000100:00100000:1.0:1787841904.883515:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502592 00000100:00100000:1.0:1787841904.883520:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502592 00000100:00100000:1.0:1787841904.883556:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787841904.883564:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877502592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841904.883598:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877502592:12345-0@lo:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841904.883604:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787841904.888182:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877502592:0@lo:400:kworker.0 00000100:00100000:2.0:1787841904.888430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877502976 00000100:00100000:2.0:1787841904.888438:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877502976 00000100:00100000:2.0:1787841904.888554:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787841904.888564:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877502976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841904.888650:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877502976:12345-0@lo:400:kworker.0 Request processed in 87us (5626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841904.888656:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787841904.889400:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787841904.889440:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98ea580 x1874687877502976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841904.889487:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877502976:0@lo:400:kworker.0 00010000:00010000:0.0:1787841905.137681:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841905.393741:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841905.393871:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877503360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841905.393944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841905.399557:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503360 00000100:00100000:2.0:1787841905.399571:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503360 00000100:00100000:2.0:1787841905.399663:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787841905.399685:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9955a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877503360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841905.399736:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841905.399816:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9955a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877503360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841905.399824:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787841905.399896:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfbcde00 x1874687877503360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841905.399918:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877503360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841905.910163:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841905.910191:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877503488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841905.910267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841905.911984:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503488 00000100:00100000:2.0:1787841905.911998:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503488 00000100:00100000:2.0:1787841905.912067:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787841905.912076:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877503488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841905.912126:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841905.912202:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877503488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841905.912208:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787841905.912619:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfbcc3c0 x1874687877503488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841905.912651:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877503488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841906.173948:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841907.186345:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841907.982970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841907.983012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841907.983045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841907.983271:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590336 00000100:00100000:0.0:1787841907.983291:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590336 00000100:00100000:0.0:1787841907.983348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 252 00000100:00100000:0.0:1787841907.983358:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858590336:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841907.983429:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858590336:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 73us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841907.983451:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 252 00000100:00100000:3.0:1787841907.983566:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590592 00000100:00100000:3.0:1787841907.983571:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590592 00000100:00100000:3.0:1787841907.983636:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590464 00000100:00100000:3.0:1787841907.983640:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590464 00000100:00100000:3.0:1787841907.983661:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 106 00000100:00100000:3.0:1787841907.983680:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858590592:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841907.983714:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858590592:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 46us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841907.983720:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 106 00000100:00100000:3.0:1787841907.983732:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 107 00000100:00100000:3.0:1787841907.983739:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858590464:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841907.983771:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858590464:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841907.983778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 107 00000100:00080000:0.0:1787841907.984071:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841908.209695:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841909.236404:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841909.331755:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:45:08 (1787841908) === 00000100:00100000:3.0:1787841909.649959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841909.650001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841909.650318:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590848 00000100:00100000:0.0:1787841909.650330:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590848 00000100:00100000:0.0:1787841909.650414:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:0.0:1787841909.650426:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9956940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:9683:x1874687858590848:12345-192.168.202.46@tcp:700:mkdir.0 00000100:00100000:0.0:1787841909.650540:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9956940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:9683:x1874687858590848:12345-192.168.202.46@tcp:700:mkdir.0 Request processed in 116us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841909.650549:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00080000:3.0:1787841909.650775:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841909.651035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858590720 00000100:00100000:2.0:1787841909.651041:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858590720 00000100:00100000:2.0:1787841909.651083:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:2.0:1787841909.651100:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9955680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858590720:12345-192.168.202.46@tcp:41:mkdir.0 00000004:00000024:2.0:1787841909.651138:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787841909.651195:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9955680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858590720:12345-192.168.202.46@tcp:41:mkdir.0 Request processed in 106us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841909.651202:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:3.0:1787841909.665561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841909.665729:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858591104 00000100:00100000:2.0:1787841909.665756:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858591104 00000100:00100000:2.0:1787841909.665849:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:2.0:1787841909.665867:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:9683:x1874687858591104:12345-192.168.202.46@tcp:36:mkdir.0 00010000:00010000:2.0:1787841909.666004:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841909.666116:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e135ea9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97988 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.666143:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94649317a300) 00010000:00010000:2.0:1787841909.666159:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841909.667201:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.667220:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.667232:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.667257:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.667265:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.667272:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841909.682193:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787841909.682219:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.682233:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.682241:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.682248:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841909.682253:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.682263:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.682281:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:3.0:1787841909.682285:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841909.682292:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.682298:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e135fc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841909.682350:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da5a243 reply state 00000000c2961fc6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841909.682362:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841909.682613:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9683:x1874687858591104:12345-192.168.202.46@tcp:36:mkdir.0 Request processed in 16746us (17062us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787841909.682625:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00010000:00010000:1.0:1787841909.688852:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841909.688882:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841909.688890:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841909.688898:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfc00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841909.688903:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841909.688912:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841909.688931:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff946487ed3b00) 00010000:00010000:1.0:1787841909.688934:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841909.688939:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841909.688945:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e135fcf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841909.698333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841909.698553:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858591232 00000100:00100000:0.0:1787841909.698565:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858591232 00000100:00100000:0.0:1787841909.698933:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:0.0:1787841909.698944:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:9684:x1874687858591232:12345-192.168.202.46@tcp:101:chmod.0 00010000:00010000:0.0:1787841909.698965:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841909.698990:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e135fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a0d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841909.699286:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e135fdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841909.699301:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e135fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841909.699313:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e135fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841909.699376:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787841909.699380:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841909.699431:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e135fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841909.701453:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e135fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a0d expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841909.701495:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e135fdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a0d expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841909.701504:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b600) 00010000:00010000:0.0:1787841909.701508:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841909.701512:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481600, rc 0) 00000100:00100000:0.0:1787841909.701592:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9684:x1874687858591232:12345-192.168.202.46@tcp:101:chmod.0 Request processed in 2651us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841909.702668:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:2.0:1787841909.709104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841909.709148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858591488 00000100:00100000:3.0:1787841909.709158:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858591488 00000100:00100000:3.0:1787841909.709265:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787841909.709277:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9684:x1874687858591488:12345-192.168.202.46@tcp:36:chmod.0 00010000:00010000:3.0:1787841909.709336:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841909.709365:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e135fdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a0d expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.709385:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b600) 00010000:00010000:3.0:1787841909.709396:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841909.709420:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.709434:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.709444:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841909.709843:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b146989 reply state 000000009dacab85 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841909.709866:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787841909.709881:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787841909.709979:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:9684:x1874687858591488:12345-192.168.202.46@tcp:36:chmod.0 Request processed in 704us (883us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787841909.709987:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00010000:00010000:3.0:1787841909.726847:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.726868:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.726877:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.726884:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841909.726889:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.726899:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.726919:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2600) 00010000:00010000:3.0:1787841909.726923:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841909.726928:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.726935:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135fe4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841909.808390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841909.809260:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858591616 00000100:00100000:3.0:1787841909.809299:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858591616 00000100:00100000:3.0:1787841909.809370:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:3.0:1787841909.809381:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9685:x1874687858591616:12345-192.168.202.46@tcp:101:chown.0 00010000:00010000:3.0:1787841909.809419:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841909.809448:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a14 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.809606:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e135ff2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.809620:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e135ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.809632:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e135ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841909.809707:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787841909.809711:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841909.809760:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e135ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.809791:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e135feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a14 expref: 9 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.809813:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e135ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a14 expref: 8 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.809823:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2600) 00010000:00010000:3.0:1787841909.809826:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841909.809829:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030e00, rc 0) 00000100:00100000:3.0:1787841909.809908:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:9685:x1874687858591616:12345-192.168.202.46@tcp:101:chown.0 Request processed in 529us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841909.810155:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:3.0:1787841909.817279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841909.817397:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858591744 00000100:00100000:2.0:1787841909.817410:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858591744 00000100:00100000:2.0:1787841909.817521:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:2.0:1787841909.817535:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9954b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:9685:x1874687858591744:12345-192.168.202.46@tcp:101:chown.0 00010000:00010000:2.0:1787841909.817575:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841909.817601:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e135ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817701:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817718:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817731:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817749:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817757:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817764:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817871:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13600e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817880:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13600e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817888:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13600e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841909.817937:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787841909.817948:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841909.817980:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13600e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.817993:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818000:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818006:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818012:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dea00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841909.818016:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818023:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818038:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2600) 00010000:00010000:2.0:1787841909.818041:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841909.818045:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818050:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818062:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818068:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818085:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818090:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841909.818093:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818098:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818105:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff946487ed3700) 00010000:00010000:2.0:1787841909.818108:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841909.818111:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818117:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136007 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818148:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e135ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a1b expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818162:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13600e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a1b expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841909.818169:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841909.818171:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841909.818174:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841909.818234:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9954b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:9685:x1874687858591744:12345-192.168.202.46@tcp:101:chown.0 Request processed in 702us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841909.818249:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787841909.852252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841909.852342:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858592000 00000100:00100000:3.0:1787841909.852353:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858592000 00000100:00100000:3.0:1787841909.852499:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:3.0:1787841909.852518:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:9685:x1874687858592000:12345-192.168.202.46@tcp:36:chown.0 00010000:00010000:3.0:1787841909.852583:0:8624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841909.852622:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13600e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a1b expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.852641:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841909.852662:0:8624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841909.852687:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.852699:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841909.852708:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841910.001762:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877503744:0@lo:400:kworker.0 00000100:00100000:1.0:1787841910.002050:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877504000:0@lo:400:kworker.0 00000100:00100000:1.0:1787841910.002103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841910.002178:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787841910.002185:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877503616:0@lo:400:kworker.0 00000100:00100000:1.0:1787841910.002214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841910.002237:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877504128:0@lo:400:kworker.0 00000100:00100000:1.0:1787841910.002289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841910.002329:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504000 00000100:00100000:1.0:1787841910.002338:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504000 00000100:00100000:1.0:1787841910.002411:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787841910.002423:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877504000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841910.002522:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877504000:12345-0@lo:400:kworker.0 Request processed in 102us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841910.002538:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787841910.002582:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787841910.002615:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2d680 x1874687877504000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841910.002630:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877504000:0@lo:400:kworker.0 00000100:00100000:0.0:1787841910.002740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503616 00000100:00100000:0.0:1787841910.002745:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503616 00000100:00100000:0.0:1787841910.002772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787841910.002780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841910.002780:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877503616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.002802:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877504256:0@lo:400:kworker.0 00000100:00100000:0.0:1787841910.002832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877503616:12345-0@lo:400:kworker.0 Request processed in 52us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841910.002839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787841910.002871:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877503616:0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.010178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841910.010266:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841910.010279:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877503872:0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.010323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841910.010373:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504256 00000100:00100000:2.0:1787841910.010381:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504256 00000100:00100000:2.0:1787841910.010480:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787841910.010491:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877504256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.010553:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877504256:12345-0@lo:400:kworker.0 Request processed in 65us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.010561:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787841910.010586:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504128 00000100:00100000:2.0:1787841910.010590:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504128 00000100:00100000:2.0:1787841910.010611:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503744 00000100:00100000:2.0:1787841910.010614:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503744 00000100:00100000:2.0:1787841910.010624:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877503872 00000100:00100000:2.0:1787841910.010626:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877503872 00000100:00100000:2.0:1787841910.010639:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787841910.010645:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877504128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.010696:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877504128:12345-0@lo:400:kworker.0 Request processed in 51us (8406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.010702:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787841910.010736:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787841910.010743:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877503744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.010775:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877503744:12345-0@lo:400:kworker.0 Request processed in 33us (7995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.010781:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787841910.010791:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787841910.010797:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877503872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.010819:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877503872:12345-0@lo:400:kworker.0 Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.010825:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787841910.011136:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841910.011142:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841910.014097:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877504128:0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.014540:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877503872:0@lo:400:kworker.0 00000100:00100000:2.0:1787841910.014569:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877503744:0@lo:400:kworker.0 00010000:00080000:2.0:1787841910.014586:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648cb2c3c0 x1874687877504256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841910.014597:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877504256:0@lo:400:kworker.0 00000004:00010000:2.0:1787841910.025337:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f238c58c reply state 0000000086c6cc57 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841910.025358:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787841910.025573:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787841910.025707:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:9685:x1874687858592000:12345-192.168.202.46@tcp:36:chown.0 Request processed in 173194us (173462us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787841910.025717:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00000001:00080000:3.0:1787841910.037564:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1787841910.046894:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.046914:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.046920:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.046927:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841910.046932:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.046940:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.046998:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9464999d2900) 00010000:00010000:1.0:1787841910.047002:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787841910.047007:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.047014:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841910.134991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.135113:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858592128 00000100:00100000:2.0:1787841910.135126:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858592128 00000100:00100000:2.0:1787841910.135224:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:2.0:1787841910.135236:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:9686:x1874687858592128:12345-192.168.202.46@tcp:101:touch.500 00010000:00010000:2.0:1787841910.135276:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841910.135316:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e13601c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a22 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841910.139158:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3771us 00010000:00010000:0.0:1787841910.192773:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.193210:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.193226:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.193249:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.193624:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.193636:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.196164:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e136031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.196188:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e136031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.196202:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e136031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841910.198659:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841910.198671:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841910.200613:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e136031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200656:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200685:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200693:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200701:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.200706:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200715:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200738:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2600) 00010000:00010000:0.0:1787841910.200742:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841910.200747:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200754:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200932:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200941:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200948:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200953:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.200964:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200971:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200980:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94648391b500) 00010000:00010000:0.0:1787841910.200982:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841910.200985:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.200992:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13602a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.201055:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e13601c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a22 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.201071:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e136031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a22 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.201079:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:0.0:1787841910.201082:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787841910.201084:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480a00, rc 0) 00000100:00100000:0.0:1787841910.201177:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9686:x1874687858592128:12345-192.168.202.46@tcp:101:touch.500 Request processed in 65942us (66200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841910.201189:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:0.0:1787841910.220728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.220864:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858592384 00000100:00100000:2.0:1787841910.220880:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858592384 00000100:00100000:2.0:1787841910.220962:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:2.0:1787841910.220974:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9686:x1874687858592384:12345-192.168.202.46@tcp:101:touch.500 00010000:00010000:2.0:1787841910.221005:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841910.221035:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136038 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.221555:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.221574:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.221588:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.223039:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.223068:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.223080:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841910.226549:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787841910.227038:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e13604d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227060:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e13604d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227073:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e13604d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227120:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227127:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227134:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227140:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dea00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841910.227145:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227153:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227167:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:2.0:1787841910.227171:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841910.227177:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227197:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13603f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841910.227214:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bd81eeb reply state 000000004fc6b3d4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841910.227224:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841910.227392:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136038 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a29 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227410:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e13604d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a29 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.227418:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841910.227421:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841910.227423:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de000, rc 0) 00000100:00100000:3.0:1787841910.228086:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:9686:x1874687858592384:12345-192.168.202.46@tcp:101:touch.500 Request processed in 7109us (7370us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787841910.228100:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:1.0:1787841910.231560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.231684:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858592640 00000100:00100000:2.0:1787841910.231699:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858592640 00000100:00100000:2.0:1787841910.231915:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:2.0:1787841910.231929:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:9686:x1874687858592640:12345-192.168.202.46@tcp:36:touch.500 00010000:00010000:2.0:1787841910.232013:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841910.232052:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e13604d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a29 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.232076:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841910.232091:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841910.232145:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.232180:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.232192:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841910.232399:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c8a3fa1 reply state 0000000074cf8d27 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841910.232411:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841910.232585:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:9686:x1874687858592640:12345-192.168.202.46@tcp:36:touch.500 Request processed in 659us (1038us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1787841910.233511:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.233528:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.233536:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.233543:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841910.233548:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.233557:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.233571:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff946487ed3700) 00010000:00010000:3.0:1787841910.233574:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841910.233579:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.233585:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136046 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841910.236087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841910.236137:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858592768 00000100:00100000:3.0:1787841910.236150:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858592768 00010000:00010000:1.0:1787841910.236282:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.236307:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.236316:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.236323:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfa00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841910.236328:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.236338:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.236358:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841910.236362:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841910.236367:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.236374:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13605b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841910.238431:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:1.0:1787841910.238938:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:1.0:1787841910.238966:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:9686:x1874687858592768:12345-192.168.202.46@tcp:101:touch.500 00010000:00010000:1.0:1787841910.239005:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841910.239037:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247600/0x1d0ed3605e136062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a30 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.239122:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247600/0x1d0ed3605e136062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a30 expref: 10 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.239139:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247600/0x1d0ed3605e136062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a30 expref: 10 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841910.239163:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94649317a200) 00010000:00010000:1.0:1787841910.239168:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841910.239172:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247600, rc 0) 00000100:00100000:1.0:1787841910.239276:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:9686:x1874687858592768:12345-192.168.202.46@tcp:101:touch.500 Request processed in 325us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841910.239283:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:3.0:1787841910.247781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.247983:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858592896 00000100:00100000:2.0:1787841910.247998:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858592896 00000100:00100000:2.0:1787841910.248065:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:2.0:1787841910.248076:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874687858592896:12345-192.168.202.46@tcp:8:touch.500 00010000:00080000:2.0:1787841910.248122:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:2.0:1787841910.248170:0:6694:0:(genops.c:1385:class_connect()) connect: client 7142e368-78a3-4f67-bb12-5e4ed629eb65, cookie 0x1d0ed3605e136069 00002000:00100000:2.0:1787841910.248188:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7142e368-78a3-4f67-bb12-5e4ed629eb65/ffff9464b7fc2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841910.248224:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841910.248626:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787841910.248680:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9464b7fc3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841910.249429:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2345:x1874687858592896:12345-192.168.202.46@tcp:8:touch.500 Request processed in 1347us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.249442:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00010000:00010000:0.0:1787841910.257729:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841910.258910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841910.259119:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858593024 00000100:00100000:3.0:1787841910.259134:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858593024 00000100:00100000:3.0:1787841910.259236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787841910.259249:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:0:x1874687858593024:12345-192.168.202.46@tcp:2:touch.500 00000100:00080000:1.0:1787841910.260131:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787841910.335011:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000001:00080000:2.0:1787841910.335039:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787841910.335253:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:0:x1874687858593024:12345-192.168.202.46@tcp:2:touch.500 Request processed in 75996us (76345us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787841910.335299:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:0.0:1787841910.342055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.342690:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858593280 00000100:00100000:2.0:1787841910.342708:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858593280 00000100:00100000:2.0:1787841910.342965:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:2.0:1787841910.342980:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:9686:x1874687858593280:12345-192.168.202.46@tcp:35:touch.500 00000100:00100000:2.0:1787841910.343925:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:9686:x1874687858593280:12345-192.168.202.46@tcp:35:touch.500 Request processed in 941us (1877us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787841910.343936:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:2.0:1787841910.361106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841910.361236:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858593408 00000100:00100000:1.0:1787841910.361251:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858593408 00000100:00100000:1.0:1787841910.361337:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:1.0:1787841910.361349:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:9687:x1874687858593408:12345-192.168.202.46@tcp:101:rm.0 00010000:00010000:1.0:1787841910.361384:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841910.361411:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a37 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.362498:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136077 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.362521:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.362536:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841910.362622:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841910.362627:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841910.363017:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.363065:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a37 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.363092:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a37 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.363103:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:0.0:1787841910.363107:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841910.363110:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481600, rc 0) 00000100:00100000:0.0:1787841910.363276:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:9687:x1874687858593408:12345-192.168.202.46@tcp:101:rm.0 Request processed in 1928us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841910.363286:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:3.0:1787841910.369085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841910.369185:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858593664 00000100:00100000:0.0:1787841910.369217:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858593664 00000100:00100000:0.0:1787841910.369306:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:0.0:1787841910.369318:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:9687:x1874687858593664:12345-192.168.202.46@tcp:101:rm.0 00010000:00010000:0.0:1787841910.369348:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841910.369375:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13607e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a3e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841910.369578:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787841910.370053:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13607e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a3e expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.370071:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2600) 00010000:00010000:0.0:1787841910.370074:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841910.370080:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13607e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a3e expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.370098:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481200, rc 0) 00000100:00100000:0.0:1787841910.370210:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:9687:x1874687858593664:12345-192.168.202.46@tcp:101:rm.0 Request processed in 894us (1138us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787841910.370219:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:0.0:1787841910.376745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841910.377250:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858593792 00000100:00100000:3.0:1787841910.377333:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858593792 00000100:00100000:3.0:1787841910.377446:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:3.0:1787841910.377494:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf9070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:9687:x1874687858593792:12345-192.168.202.46@tcp:37:rm.0 00000100:00100000:2.0:1787841910.388789:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf9070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:9687:x1874687858593792:12345-192.168.202.46@tcp:37:rm.0 Request processed in 11291us (12016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.388808:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:1.0:1787841910.408132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.408348:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858594048 00000100:00100000:2.0:1787841910.408362:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858594048 00000100:00100000:2.0:1787841910.408448:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:2.0:1787841910.408483:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649855ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:9687:x1874687858594048:12345-192.168.202.46@tcp:35:rm.0 00000100:00100000:2.0:1787841910.409263:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649855ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:9687:x1874687858594048:12345-192.168.202.46@tcp:35:rm.0 Request processed in 800us (1142us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787841910.409274:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:1.0:1787841910.422056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841910.422179:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858594304 00000100:00100000:2.0:1787841910.422193:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858594304 00000100:00100000:2.0:1787841910.422282:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:2.0:1787841910.422295:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:9687:x1874687858594304:12345-192.168.202.46@tcp:101:rm.0 00010000:00010000:2.0:1787841910.422335:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841910.422385:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e13608c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a45 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.422612:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136093 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.422630:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.422657:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841910.422671:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787841910.423171:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e13608c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a45 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.423196:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136093 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a45 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.423206:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:2.0:1787841910.423210:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841910.423215:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df200, rc 0) 00000100:00100000:2.0:1787841910.423406:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858594304:12345-192.168.202.46@tcp:101:rm.0 Request processed in 1113us (1366us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787841910.423417:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:2.0:1787841910.437157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841910.440419:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858594432 00000100:00100000:0.0:1787841910.440439:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858594432 00000100:00100000:0.0:1787841910.441946:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 28 00000100:00100000:0.0:1787841910.441966:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858594432:12345-192.168.202.46@tcp:41:rm.0 00000004:00000024:0.0:1787841910.442061:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787841910.442275:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858594432:12345-192.168.202.46@tcp:41:rm.0 Request processed in 313us (5134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841910.442309:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 28 00000100:00100000:1.0:1787841910.458984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841910.460918:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858594560 00000100:00100000:0.0:1787841910.460941:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858594560 00000100:00100000:0.0:1787841910.461162:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:0.0:1787841910.461174:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858594560:12345-192.168.202.46@tcp:101:rm.0 00010000:00010000:0.0:1787841910.461201:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841910.461228:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1360a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461326:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461344:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461357:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461376:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461383:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461390:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461559:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461589:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461597:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841910.461633:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787841910.461639:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841910.461673:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461688:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461697:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461712:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461720:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461743:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.461748:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461757:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.461772:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:0.0:1787841910.462679:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841910.462754:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.462766:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1360a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.462907:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.462916:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.462923:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.462928:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.463030:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.463041:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.463056:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff94648391b500) 00010000:00010000:0.0:1787841910.463058:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841910.463062:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.463069:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1360af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.463124:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1360a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a4c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.463154:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a4c expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.463162:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94649317a200) 00010000:00010000:0.0:1787841910.463165:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841910.463168:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787841910.463273:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:9687:x1874687858594560:12345-192.168.202.46@tcp:101:rm.0 Request processed in 2101us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841910.463283:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:2.0:1787841910.467001:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841910.467107:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858594816 00000100:00100000:0.0:1787841910.467121:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858594816 00000100:00100000:0.0:1787841910.467246:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 30 00000100:00100000:0.0:1787841910.467266:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:9687:x1874687858594816:12345-192.168.202.46@tcp:36:rm.0 00010000:00010000:0.0:1787841910.467340:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787841910.467376:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1360b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a4c expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467406:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247600/0x1d0ed3605e136062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a30 expref: 16 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467419:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94649317a200) 00010000:00010000:0.0:1787841910.467436:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136077 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a37 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467447:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:0.0:1787841910.467506:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841910.467535:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467551:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467564:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467579:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467587:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467593:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467790:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467798:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.467804:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841910.468740:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787841910.468757:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299443298723ns, next at 300443294628ns, rc = 0 00010000:00010000:0.0:1787841910.468838:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468866:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468877:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468886:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468893:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468901:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468930:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841910.468958:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468965:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468971:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468978:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.468983:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.468992:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469015:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648391b400) 00010000:00010000:0.0:1787841910.469018:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787841910.469024:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469031:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1360cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469052:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469058:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469065:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469070:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.469073:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469078:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469085:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:0.0:1787841910.469087:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841910.469089:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.469095:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1360bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841910.469115:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0a9f4ac reply state 00000000395ab177 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841910.469125:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841910.469244:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858594816:12345-192.168.202.46@tcp:36:rm.0 Request processed in 1984us (2254us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787841910.469255:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 30 00010000:00010000:2.0:1787841910.469374:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841910.469383:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.469401:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841910.469405:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.469412:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.469422:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648391b400) 00010000:00010000:2.0:1787841910.469424:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787841910.469427:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.469433:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e1360d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.469451:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841910.469453:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841910.469488:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841910.473630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1787841910.474588:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.474604:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.474612:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.474618:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841910.474623:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.474663:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.474686:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff94648391b700) 00010000:00010000:2.0:1787841910.474689:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841910.474696:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841910.474704:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1360c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841910.475128:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595072 00000100:00100000:1.0:1787841910.475143:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595072 00000100:00100000:1.0:1787841910.475227:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:1.0:1787841910.475240:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:9687:x1874687858595072:12345-192.168.202.46@tcp:35:rm.0 00000100:00100000:1.0:1787841910.476593:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858595072:12345-192.168.202.46@tcp:35:rm.0 Request processed in 1346us (2970us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787841910.476604:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:3.0:1787841910.484448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841910.484772:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595328 00000100:00100000:0.0:1787841910.484791:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595328 00000100:00100000:0.0:1787841910.484881:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:0.0:1787841910.484894:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:9687:x1874687858595328:12345-192.168.202.46@tcp:36:rm.0 00010000:00010000:0.0:1787841910.484980:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787841910.485019:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a45 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485047:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e136031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a22 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485063:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391b000) 00010000:00010000:0.0:1787841910.485084:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e135ff2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a14 expref: 14 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485094:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2600) 00010000:00010000:0.0:1787841910.485101:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841910.485132:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485172:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485185:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485200:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485208:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485214:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485684:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485695:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.485704:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841910.486522:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787841910.486550:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486558:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486565:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486580:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.486585:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486593:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486607:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648391be00) 00010000:00010000:0.0:1787841910.486611:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787841910.486617:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486624:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd600/0x1d0ed3605e1360e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486665:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486671:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486677:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486681:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dc600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841910.486684:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486689:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486711:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b500) 00010000:00010000:0.0:1787841910.486713:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841910.486716:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841910.486722:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e1360d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841910.486738:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033f6e5a3 reply state 0000000014398677 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841910.486748:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841910.486875:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:9687:x1874687858595328:12345-192.168.202.46@tcp:36:rm.0 Request processed in 1979us (2438us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787841910.486887:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 31 00010000:00010000:3.0:1787841910.491523:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.491549:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.491558:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.491565:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dca00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841910.491571:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.491581:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.491604:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94648391ba00) 00010000:00010000:3.0:1787841910.491607:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841910.491614:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841910.491622:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e1360e0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841910.513964:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877504384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841910.514076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841910.514246:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504384 00000100:00100000:2.0:1787841910.514265:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504384 00000100:00100000:2.0:1787841910.514333:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787841910.514343:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877504384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841910.514389:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841910.514450:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877504384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841910.514485:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787841910.514627:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648c910f00 x1874687877504384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841910.514659:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877504384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841911.028046:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877504512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841911.028155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841911.028524:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504512 00000100:00100000:2.0:1787841911.028536:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504512 00000100:00100000:2.0:1787841911.029233:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787841911.029246:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf906940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877504512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841911.029284:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841911.029381:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf906940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877504512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841911.029389:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787841911.029500:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648c911e00 x1874687877504512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841911.029526:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877504512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841911.281721:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841912.311082:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841913.104006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841913.104057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841913.104132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841913.104172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841913.104236:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595456 00000100:00100000:1.0:1787841913.104247:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595456 00000100:00100000:1.0:1787841913.104324:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 254 00000100:00100000:1.0:1787841913.104336:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858595456:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841913.104432:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858595456:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841913.104439:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 254 00000100:00100000:3.0:1787841913.110692:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595712 00000100:00100000:3.0:1787841913.110708:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595712 00000100:00100000:3.0:1787841913.110790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:3.0:1787841913.110800:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858595712:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841913.110876:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858595712:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 77us (6818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841913.110883:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00080000:2.0:1787841913.112117:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841913.112437:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595584 00000100:00100000:1.0:1787841913.114119:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595584 00000100:00100000:1.0:1787841913.114204:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595840 00000100:00100000:1.0:1787841913.114207:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595840 00000100:00080000:2.0:1787841913.114313:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841913.114365:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 111 00000100:00100000:3.0:1787841913.114379:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2346:x1874687858595584:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841913.114566:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2346:x1874687858595584:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 120us (10361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841913.114574:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 111 00000100:00100000:3.0:1787841913.114593:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 112 00000100:00100000:3.0:1787841913.114600:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486734780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858595840:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841913.114639:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486734780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858595840:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 39us (10466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841913.114646:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 112 00010000:00010000:0.0:1787841913.329946:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841914.354972:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841915.130728:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877504640:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.130811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841915.130853:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf904b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877505152:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.130879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841915.130904:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841915.130916:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877505024:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.130942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841915.130969:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf906d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877504768:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.130990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841915.131005:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877505280:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841915.131037:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841915.131042:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877504896:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841915.131118:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504640 00000100:00100000:0.0:1787841915.131126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504640 00000100:00100000:0.0:1787841915.131223:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787841915.131232:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877504640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131281:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877504640:12345-0@lo:400:kworker.0 Request processed in 51us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841915.131288:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787841915.131318:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505024 00000100:00100000:0.0:1787841915.131321:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505024 00000100:00100000:0.0:1787841915.131352:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505280 00000100:00100000:0.0:1787841915.131354:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505280 00000100:00100000:0.0:1787841915.131368:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787841915.131374:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf907840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877505024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131402:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf907840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877505024:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841915.131408:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787841915.131418:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787841915.131422:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877505280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131481:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877505280:12345-0@lo:400:kworker.0 Request processed in 58us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841915.131487:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787841915.131505:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505152 00000100:00100000:0.0:1787841915.131508:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505152 00000100:00100000:0.0:1787841915.131529:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504768 00000100:00100000:0.0:1787841915.131531:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504768 00000100:00100000:0.0:1787841915.131540:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877504896 00000100:00100000:0.0:1787841915.131541:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877504896 00000100:00100000:0.0:1787841915.131552:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787841915.131558:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877505152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131585:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877505152:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841915.131591:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787841915.131614:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787841915.131619:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf905a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877504768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131657:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf905a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877504768:12345-0@lo:400:kworker.0 Request processed in 38us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841915.131663:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787841915.131673:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787841915.131679:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf907c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877504896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131699:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf907c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877504896:12345-0@lo:400:kworker.0 Request processed in 21us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841915.131705:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787841915.131893:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877504896:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131902:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf906d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877504768:0@lo:400:kworker.0 00010000:00080000:0.0:1787841915.131921:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf9061c0 x1874687877505280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841915.131930:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877505280:0@lo:400:kworker.0 00010000:00080000:0.0:1787841915.131967:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf905e00 x1874687877505024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841915.131976:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877505024:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131983:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877504640:0@lo:400:kworker.0 00000100:00100000:0.0:1787841915.131991:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf904b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877505152:0@lo:400:kworker.0 00000100:00080000:2.0:1787841915.137206:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841915.137215:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841915.137218:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787841915.175118:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787841915.175132:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787841915.175288:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877505408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787841915.175354:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841915.175408:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505408 00000100:00100000:2.0:1787841915.175415:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505408 00000100:00100000:2.0:1787841915.175482:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787841915.175492:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c911e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877505408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787841915.175521:0:6693:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787841915.175555:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a904d77, atime: 0x6a904d77, ctime: 0x6a904d77, blocks: 0x1 00010000:00010000:2.0:1787841915.175563:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.175581:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1787841915.175585:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841915.175591:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.175621:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.175632:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.175652:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.175668:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787841915.176140:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c911e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877505408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 649us (785us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787841915.176148:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787841915.176175:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841915.176181:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.176190:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841915.176195:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.176204:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.176220:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.176228:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e1360ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841915.176244:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841915.176252:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841915.176253:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787841915.176281:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94648c9121c0/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787841915.176287:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877505408:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787841915.378878:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841915.635296:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486737c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877505536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841915.635369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841915.638346:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505536 00000100:00100000:3.0:1787841915.638358:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505536 00000100:00100000:3.0:1787841915.638421:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787841915.638431:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877505536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841915.638484:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841915.638557:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877505536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841915.638565:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787841915.638623:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946486737c00 x1874687877505536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841915.638644:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486737c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877505536:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787841915.644160:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1787841915.728021:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1787841916.146910:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877505664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841916.147003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841916.148172:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505664 00000100:00100000:2.0:1787841916.148183:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505664 00000100:00100000:2.0:1787841916.148246:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787841916.148266:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486737c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877505664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841916.148305:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841916.148578:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787841916.148596:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94648c9121c0, transno 4294967300 00000100:00100000:3.0:1787841916.148627:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877505664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841916.149120:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486737c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877505664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841916.149131:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1787841916.409925:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841917.431083:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787841917.495997:0:11668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc12163710 20000000:00000080:0.0:1787841917.496014:0:11668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464b98bd000 uarg=0000000000000000 20000000:01000000:0.0:1787841917.496048:0:11668:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787841917.496055:0:11668:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787841917.496060:0:11668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787841917.497279:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787841917.497431:0:11668:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787841917.521861:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787841917.521952:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787841917.522339:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787841917.523040:0:11668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787841917.523061:0:11668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523081:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523089:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523113:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523120:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523127:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523135:0:11668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523172:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523185:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 18 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.523208:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486736580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877505792:0@lo:104: 00000100:00100000:3.0:1787841917.523264:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841917.523320:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523329:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 18 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.523337:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867370c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877505920:0@lo:104: 00000100:00100000:3.0:1787841917.523367:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841917.523399:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523412:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 18 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.523421:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486734f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877506048:0@lo:104: 00000100:00100000:3.0:1787841917.523444:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841917.523479:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523489:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 12 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.523498:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486735680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877506176:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841917.523554:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.523563:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.523572:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486736d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877506304:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841917.523603:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841917.523895:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787841917.523907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505792 00000100:00100000:0.0:1787841917.523913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505792 00000100:00100000:0.0:1787841917.523946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877505920 00000100:00100000:0.0:1787841917.523949:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877505920 00000100:00100000:0.0:1787841917.523959:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877506048 00000100:00100000:0.0:1787841917.523962:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877506048 00000100:00100000:0.0:1787841917.523974:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841917.523982:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+5:11668:x1874687877505792:12345-0@lo:104: 00010000:00010000:0.0:1787841917.523995:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524061:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841917.524067:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+5:11668:x1874687877505792:12345-0@lo:104: Request processed in 85us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841917.524075:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841917.524094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787841917.524101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486736940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:11668:x1874687877505920:12345-0@lo:104: 00010000:00010000:0.0:1787841917.524108:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524138:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787841917.524143:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486736940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+4:11668:x1874687877505920:12345-0@lo:104: Request processed in 44us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841917.524149:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787841917.524160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841917.524166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463811bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:11668:x1874687877506048:12345-0@lo:104: 00010000:00010000:0.0:1787841917.524174:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524205:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787841917.524210:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463811bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:907da169-f099-4269-9458-b15bc87a550d+3:11668:x1874687877506048:12345-0@lo:104: Request processed in 44us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841917.524215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787841917.524251:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787841917.524256:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524262:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841917.524273:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524282:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841917.524289:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841917.524295:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841917.524322:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524328:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841917.524343:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524350:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e135fba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fc1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524362:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787841917.524366:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524385:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841917.524388:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524395:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841917.524412:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841917.524417:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841917.524430:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524436:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841917.524442:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524449:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946480030800/0x1d0ed3605e135fac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524484:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841917.524488:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524493:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787841917.524495:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.524502:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841917.524509:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841917.524514:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841917.524944:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841917.524957:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877506432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841917.524993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841917.525026:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841917.525032:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877506560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841917.525051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841917.525078:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877506432 00000100:00100000:2.0:1787841917.525082:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877506432 00010000:00010000:2.0:1787841917.525099:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 19 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841917.525116:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877506560 00000100:00100000:2.0:1787841917.525118:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877506560 00010000:00010000:2.0:1787841917.525126:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 20 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841917.525147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841917.525153:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c910f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+20:3308:x1874687877506432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841917.525162:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841917.525166:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 20 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.525175:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 20 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.525201:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841917.525226:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c910f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+20:3308:x1874687877506432:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841917.525232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841917.525244:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787841917.525248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877506560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841917.525255:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841917.525258:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 19 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.525265:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 19 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.525273:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841917.525289:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877506560:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841917.525295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787841917.525328:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877506560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841917.525344:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877506432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841917.525507:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.525514:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841917.525543:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.525549:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480600/0x1d0ed3605e135f9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e135fa5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.525563:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841917.525565:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841917.525566:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841917.525572:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841917.525596:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841917.525605:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877506688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841917.525634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841917.527052:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7247200/0x1d0ed3605e135fc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135fba expref: 18 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.527067:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486736580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877505792:0@lo:104: 00010000:00010000:3.0:1787841917.527078:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7246000/0x1d0ed3605e135fb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135fac expref: 17 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841917.527106:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867370c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877505920:0@lo:104: 00000100:00100000:3.0:1787841917.527116:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486734f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877506048:0@lo:104: 00000100:00100000:2.0:1787841917.528077:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877506688 00000100:00100000:2.0:1787841917.528086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877506688 00010000:00010000:2.0:1787841917.528122:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 17 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841917.528161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787841917.528171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+17:3307:x1874687877506688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841917.528193:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841917.528198:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 17 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.528210:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 17 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.528227:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480031000/0x1d0ed3605e135fa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e135f9e expref: 17 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841917.528239:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841917.528296:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+16:3307:x1874687877506688:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841917.528303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787841917.529142:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877506688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841917.531015:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486735680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877506176:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841917.531028:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486736d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1874687877506304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841917.531060:0:11668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841917.536163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841917.536488:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858595968 00000100:00100000:0.0:1787841917.536498:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858595968 00010000:00010000:0.0:1787841917.536533:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 13 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841917.536568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:0.0:1787841917.536585:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858595968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841917.536600:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841917.536605:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 13 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.536633:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 13 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.536652:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7247000/0x1d0ed3605e135f97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a06 expref: 13 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841917.536665:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841917.536904:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:2349:x1874687858595968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 327us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841917.536913:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:2.0:1787841917.542549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841917.542635:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596096 00000100:00100000:1.0:1787841917.542645:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596096 00010000:00010000:1.0:1787841917.542684:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841917.542733:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:1.0:1787841917.542742:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:2349:x1874687858596096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841917.542762:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841917.542769:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542781:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542801:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7247a00/0x1d0ed3605e135f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ff expref: 12 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542817:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542826:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542861:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542868:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542874:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542881:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542887:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787841917.542890:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542898:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542917:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841917.542928:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841917.542983:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2349:x1874687858596096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 242us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841917.542990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 34 00010000:00010000:3.0:1787841917.543145:0:11668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.543155:0:11668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841917.543162:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030200/0x1d0ed3605e1360f5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841918.222773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841918.223043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596224 00000100:00100000:2.0:1787841918.223053:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596224 00000100:00100000:2.0:1787841918.223210:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 256 00000100:00100000:2.0:1787841918.223430:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2349:x1874687858596224:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841918.223662:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2349:x1874687858596224:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 237us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.223671:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 256 00000100:00100000:0.0:1787841918.232060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841918.232421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841918.232970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841918.233800:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596480 00000100:00100000:3.0:1787841918.233809:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596480 00000100:00100000:3.0:1787841918.233895:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:3.0:1787841918.233905:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858596480:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841918.233983:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858596480:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 80us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841918.233991:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00080000:0.0:1787841918.234870:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841918.236527:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596352 00000100:00100000:1.0:1787841918.236542:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596352 00000100:00100000:2.0:1787841918.237044:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596608 00000100:00100000:2.0:1787841918.237050:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596608 00000100:00100000:1.0:1787841918.237199:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:1.0:1787841918.237283:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf9061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858596352:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841918.237365:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf9061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858596352:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 85us (5315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841918.237373:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:2.0:1787841918.237733:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:2.0:1787841918.237740:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf906d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858596608:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841918.237780:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf906d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858596608:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 40us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.237786:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00080000:0.0:1787841918.240834:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787841918.449701:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787841918.642774:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841918.642782:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464c1af7000 from 7 10000000:01000000:0.0:1787841918.642787:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841918.642847:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.642859:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.642870:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841918.642897:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877506816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.642966:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841918.643055:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841918.643269:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877506816 00000100:00100000:1.0:1787841918.643277:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877506816 00000100:00100000:1.0:1787841918.643339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787841918.643349:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+16:5847:x1874687877506816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841918.643362:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841918.643373:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7247600/0x1d0ed3605e136103 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e1360fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.643395:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7247600/0x1d0ed3605e136103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e1360fc expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.643406:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7247600/0x1d0ed3605e136103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e1360fc expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.643416:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247600, rc 0) 00000100:00100000:1.0:1787841918.643489:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877506816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841918.643496:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787841918.643964:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877506816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841918.643981:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.643990:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841918.644044:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877506944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.644067:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841918.644104:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841918.644253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877506944 00000100:00100000:2.0:1787841918.644259:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877506944 00000100:00100000:2.0:1787841918.644295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787841918.644303:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877506944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841918.644583:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877506944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.644591:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787841918.644672:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877506944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841918.644702:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841918.644757:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841918.644783:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841918.644921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507072 00000100:00100000:2.0:1787841918.644926:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507072 00000100:00100000:2.0:1787841918.644958:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787841918.644965:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877507072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841918.645095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877507072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.645102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787841918.645274:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.645780:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11681:1874687877507200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841918.645828:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841918.645858:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787841918.646035:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507200 00000100:00100000:2.0:1787841918.646045:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507200 00000100:00100000:2.0:1787841918.646081:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787841918.646088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:11681:x1874687877507200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841918.646245:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+17:11681:x1874687877507200:12345-0@lo:502:llog_process_th.0 Request processed in 157us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.646252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787841918.646938:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11681:1874687877507200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841918.646970:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841918.646981:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841918.646984:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787841918.646989:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9464c1af7000 00000020:00000080:0.0:1787841918.646992:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787841918.647387:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11681:1874687877507328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841918.647436:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841918.647500:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841918.647645:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507328 00000100:00100000:1.0:1787841918.647650:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507328 00000100:00100000:1.0:1787841918.647692:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787841918.647702:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:11681:x1874687877507328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841918.647906:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+17:11681:x1874687877507328:12345-0@lo:502:llog_process_th.0 Request processed in 206us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841918.647921:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787841918.648095:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11681:1874687877507328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841918.648129:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841918.648134:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841918.648136:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787841918.648143:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787841918.648581:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787841918.648597:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841918.648607:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.648618:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841918.648627:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787841918.648630:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946486706000 from 7 10000000:01000000:1.0:1787841918.648632:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841918.648660:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.648669:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.648679:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841918.648696:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841918.648742:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841918.648774:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.648926:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507456 00000100:00100000:0.0:1787841918.648931:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507456 00000100:00100000:0.0:1787841918.648970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787841918.648978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+17:5847:x1874687877507456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841918.648988:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841918.649001:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e136111 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e13610a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.649021:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e136111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e13610a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.649032:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e136111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e13610a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.649041:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dcc00, rc 0) 00000100:00100000:0.0:1787841918.649073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877507456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841918.649079:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787841918.649666:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841918.649681:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841918.649689:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841918.649767:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841918.649797:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841918.649833:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841918.650148:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507584 00000100:00100000:2.0:1787841918.650154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507584 00000100:00100000:2.0:1787841918.650184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787841918.650193:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877507584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841918.650610:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877507584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.650617:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787841918.652408:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841918.652510:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841918.652593:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841918.652633:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.652866:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507712 00000100:00100000:0.0:1787841918.652874:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507712 00000100:00100000:0.0:1787841918.652917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787841918.652927:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877507712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.653104:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877507712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841918.653124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787841918.653397:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877507712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841918.659310:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11682:1874687877507840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841918.659402:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841918.659500:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.659716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507840 00000100:00100000:0.0:1787841918.659723:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507840 00000100:00100000:0.0:1787841918.659759:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787841918.659773:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:11682:x1874687877507840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841918.659974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+18:11682:x1874687877507840:12345-0@lo:502:llog_process_th.0 Request processed in 201us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841918.659982:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787841918.660070:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11682:1874687877507840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841918.660095:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841918.660104:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841918.660106:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787841918.660113:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946486706000 00000020:00000080:2.0:1787841918.660116:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787841918.660174:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11682:1874687877507968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841918.660205:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841918.660297:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.660424:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877507968 00000100:00100000:0.0:1787841918.660428:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877507968 00000100:00100000:0.0:1787841918.660478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787841918.660486:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:11682:x1874687877507968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841918.660606:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+18:11682:x1874687877507968:12345-0@lo:502:llog_process_th.0 Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841918.660612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787841918.660680:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11682:1874687877507968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841918.660701:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841918.660705:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841918.660706:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787841918.660710:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787841918.660844:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787841918.660863:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841918.660927:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.660940:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841918.660951:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841918.660953:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946485cca000 from 7 10000000:01000000:0.0:1787841918.660956:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841918.660980:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.660987:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.660996:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841918.661017:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877508096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.661048:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841918.661106:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841918.663976:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508096 00000100:00100000:2.0:1787841918.663989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508096 00000100:00100000:2.0:1787841918.664086:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787841918.664095:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+18:5847:x1874687877508096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841918.664112:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841918.664129:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6df400/0x1d0ed3605e13611f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136118 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841918.664157:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6df400/0x1d0ed3605e13611f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136118 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841918.664168:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6df400/0x1d0ed3605e13611f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136118 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841918.664177:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df400, rc 0) 00000100:00100000:2.0:1787841918.665419:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877508096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1320us (4363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.665430:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787841918.665574:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877508096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841918.665598:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841918.665609:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841918.665678:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877508224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.665716:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841918.665748:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464903e3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.665764:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508224 00000100:00100000:0.0:1787841918.665768:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508224 00000100:00100000:0.0:1787841918.665796:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787841918.665803:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877508224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.671507:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877508224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5696us (5782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841918.671522:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787841918.674973:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877508224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841918.675045:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877508352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841918.675129:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841918.675180:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.675501:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508352 00000100:00100000:0.0:1787841918.675509:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508352 00000100:00100000:0.0:1787841918.675561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787841918.675580:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877508352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841918.675791:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:5847:x1874687877508352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841918.676059:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:907da169-f099-4269-9458-b15bc87a550d:5847:1874687877508352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841918.676268:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11684:1874687877508480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841918.676308:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841918.676331:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841918.676582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787841918.676616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508480 00000100:00100000:0.0:1787841918.676620:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508480 00000100:00100000:0.0:1787841918.676637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787841918.676644:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:11684:x1874687877508480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841918.676828:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:11684:x1874687877508480:12345-0@lo:502:llog_process_th.0 Request processed in 183us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841918.676835:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787841918.677164:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11684:1874687877508480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841918.677202:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841918.677282:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841918.677285:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787841918.677296:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946485cca000 00000020:00000080:2.0:1787841918.677300:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787841918.677394:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11684:1874687877508608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841918.677436:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841918.677494:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508608 00000100:00100000:2.0:1787841918.677498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508608 00000100:00100000:2.0:1787841918.677537:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787841918.677550:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:11684:x1874687877508608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841918.677708:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:11684:x1874687877508608:12345-0@lo:502:llog_process_th.0 Request processed in 158us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841918.677717:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787841918.677761:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841918.677776:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:907da169-f099-4269-9458-b15bc87a550d:11684:1874687877508608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841918.677796:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841918.677801:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841918.677802:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787841918.677806:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787841918.680998:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787841918.681034:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841918.681047:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841918.681061:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841918.697629:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787841919.057308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841919.057445:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596736 00000100:00100000:0.0:1787841919.057501:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596736 00000100:00100000:0.0:1787841919.057577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 272 00000100:00100000:0.0:1787841919.057588:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:5589:x1874687858596736:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841919.057605:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841919.057624:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464829dc000/0x1d0ed3605e136126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841919.057650:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464829dc000/0x1d0ed3605e136126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a53 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841919.057661:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464829dc000/0x1d0ed3605e136126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a53 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841919.057671:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dc000, rc 0) 00000100:00100000:0.0:1787841919.057748:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858596736:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 153us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841919.057756:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 272 00000100:00100000:2.0:1787841919.062065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841919.062173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596864 00000100:00100000:0.0:1787841919.062185:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596864 00000100:00100000:0.0:1787841919.062247:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 273 00000100:00100000:0.0:1787841919.062258:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858596864:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841919.062609:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858596864:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 353us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841919.062618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 273 00000100:00100000:1.0:1787841919.067546:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841919.068951:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858596992 00000100:00100000:0.0:1787841919.068964:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858596992 00000100:00100000:0.0:1787841919.069033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 274 00000100:00100000:0.0:1787841919.069044:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858596992:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841919.069624:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858596992:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 580us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841919.069632:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 274 00000100:00100000:1.0:1787841919.086283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841919.086422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597120 00000100:00100000:2.0:1787841919.086434:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597120 00000100:00100000:2.0:1787841919.086515:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 275 00000100:00100000:2.0:1787841919.086534:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:9958:x1874687858597120:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841919.087180:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:9958:x1874687858597120:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 648us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841919.087189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 275 00000100:00100000:2.0:1787841919.109074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841919.109158:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597248 00000100:00100000:0.0:1787841919.109168:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597248 00000100:00100000:0.0:1787841919.109238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 276 00000100:00100000:0.0:1787841919.109248:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:9958:x1874687858597248:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841919.109553:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:9958:x1874687858597248:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 306us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841919.109570:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 276 00000100:00100000:1.0:1787841919.114650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841919.119940:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597376 00000100:00100000:2.0:1787841919.119956:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597376 00000100:00100000:2.0:1787841919.120016:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 277 00000100:00100000:2.0:1787841919.120038:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:5589:x1874687858597376:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841919.120056:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841919.120073:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6df800/0x1d0ed3605e13612d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a5a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841919.120103:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6df800/0x1d0ed3605e13612d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a5a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841919.120114:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6df800/0x1d0ed3605e13612d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a5a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841919.120123:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df800, rc 0) 00000100:00100000:2.0:1787841919.120204:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858597376:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 167us (5563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841919.120211:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 277 00000100:00100000:1.0:1787841919.137555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841919.138278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597504 00000100:00100000:2.0:1787841919.138288:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597504 00000100:00100000:2.0:1787841919.138492:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 278 00000100:00100000:2.0:1787841919.138502:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858597504:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841919.140630:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858597504:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 2121us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841919.140642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 278 00000100:00100000:3.0:1787841919.152636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841919.153115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597632 00000100:00100000:0.0:1787841919.153133:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597632 00000100:00100000:0.0:1787841919.153191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 279 00000100:00100000:0.0:1787841919.153200:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858597632:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841919.153437:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:5589:x1874687858597632:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 237us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841919.153444:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 279 00000100:00100000:1.0:1787841919.159072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841919.159257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597760 00000100:00100000:2.0:1787841919.159269:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597760 00000100:00100000:2.0:1787841919.159331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 280 00000100:00100000:2.0:1787841919.159341:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:9961:x1874687858597760:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841919.159670:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:9961:x1874687858597760:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 329us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841919.159678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 280 00000100:00100000:1.0:1787841919.163894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841919.164286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858597888 00000100:00100000:2.0:1787841919.164298:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858597888 00000100:00100000:2.0:1787841919.164411:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 281 00000100:00100000:2.0:1787841919.164422:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:9961:x1874687858597888:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841919.164776:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:9961:x1874687858597888:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 355us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841919.164784:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 281 00010000:00010000:2.0:1787841919.474500:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841919.736164:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787841920.243711:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877508736:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.243801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841920.243847:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877509248:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.243875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841920.243905:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841920.243911:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877509120:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.243937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841920.243969:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509248 00000100:00100000:1.0:1787841920.243975:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509248 00000100:00100000:1.0:1787841920.244033:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787841920.244042:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877509248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244091:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877509248:12345-0@lo:400:kworker.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.244099:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787841920.244120:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841920.244160:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877509248:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244388:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509120 00000100:00100000:1.0:1787841920.244393:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509120 00000100:00100000:1.0:1787841920.244432:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787841920.244439:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877509120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244512:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877509120:12345-0@lo:400:kworker.0 Request processed in 73us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.244518:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787841920.244536:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877508992:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841920.244599:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787841920.244605:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877508864:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841920.244648:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877509376:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787841920.244887:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841920.244898:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509376 00000100:00100000:1.0:1787841920.244902:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509376 00000100:00100000:1.0:1787841920.244933:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841920.244941:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877509376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.244990:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877509376:12345-0@lo:400:kworker.0 Request processed in 51us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.244997:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841920.245027:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877509120:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.245050:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508992 00000100:00100000:1.0:1787841920.245054:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508992 00000100:00100000:1.0:1787841920.245080:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508864 00000100:00100000:1.0:1787841920.245083:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508864 00000100:00100000:1.0:1787841920.245100:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787841920.245106:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877508992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.245137:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877508992:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.245141:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787841920.245151:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787841920.245156:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877508864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.245179:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877508864:12345-0@lo:400:kworker.0 Request processed in 23us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.245184:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1787841920.245211:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841920.245214:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841920.245230:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877508864:0@lo:400:kworker.0 00010000:00080000:1.0:1787841920.245241:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b7ac0f00 x1874687877509376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841920.245251:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877509376:0@lo:400:kworker.0 00000100:00100000:1.0:1787841920.245260:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877508992:0@lo:400:kworker.0 00000100:00100000:0.0:1787841920.246201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877508736 00000100:00100000:0.0:1787841920.246208:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877508736 00000100:00100000:0.0:1787841920.246240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787841920.246248:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841920.246308:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648679b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877508736:12345-0@lo:400:kworker.0 Request processed in 61us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841920.246315:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787841920.246577:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877508736:0@lo:400:kworker.0 00010000:00010000:0.0:1787841920.499160:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841920.754363:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841920.754439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841920.754610:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509504 00000100:00100000:2.0:1787841920.754620:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509504 00000100:00100000:2.0:1787841920.754673:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787841920.754682:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486736d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877509504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841920.754715:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841920.754764:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486736d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877509504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841920.754771:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787841920.756895:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382352d00 x1874687877509504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841920.756923:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841921.266969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486735680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877509632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841921.267041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841921.267138:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509632 00000100:00100000:3.0:1787841921.267145:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509632 00000100:00100000:3.0:1787841921.267192:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841921.267198:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877509632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841921.267228:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841921.267260:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877509632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.267264:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787841921.267393:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486735680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877509632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841921.521828:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841922.545784:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841923.347612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841923.347652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841923.347696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841923.347728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841923.347918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598016 00000100:00100000:0.0:1787841923.347929:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598016 00000100:00100000:0.0:1787841923.347984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 283 00000100:00100000:0.0:1787841923.347993:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858598016:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841923.348062:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858598016:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 70us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841923.348069:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 283 00000100:00100000:2.0:1787841923.348153:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598144 00000100:00100000:2.0:1787841923.348158:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598144 00000100:00100000:2.0:1787841923.348214:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598400 00000100:00100000:2.0:1787841923.348217:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598400 00000100:00100000:2.0:1787841923.348237:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:2.0:1787841923.348244:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486734f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858598144:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841923.348287:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486734f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858598144:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 44us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841923.348308:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:2.0:1787841923.348321:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:2.0:1787841923.348327:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858598400:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841923.348351:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858598400:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 24us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841923.348358:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:1.0:1787841923.348436:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598272 00000100:00100000:1.0:1787841923.348440:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598272 00000100:00100000:1.0:1787841923.348532:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:1.0:1787841923.348541:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486736580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858598272:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841923.348568:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486736580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858598272:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 30us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841923.348574:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00080000:0.0:1787841923.348816:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841923.348821:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841923.572057:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841924.593650:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841925.364186:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877510016:0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.364259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841925.364324:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787841925.364330:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877509888:0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.364350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841925.364365:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf904f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877510400:0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.364384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841925.364413:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510016 00000100:00100000:0.0:1787841925.364419:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510016 00000100:00100000:0.0:1787841925.364485:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509888 00000100:00100000:0.0:1787841925.364488:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509888 00000100:00100000:0.0:1787841925.364520:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787841925.364529:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877510016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.364602:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877510016:12345-0@lo:400:kworker.0 Request processed in 62us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841925.364609:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787841925.364625:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787841925.364631:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf9070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877509888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.364658:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf9070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877509888:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841925.364664:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787841925.364678:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841925.364837:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf906580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877509888:0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.364852:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877510016:0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.365292:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877509760:0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.365337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841925.365378:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877510272:0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.365399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841925.365417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841925.365422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877510144:0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.365442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841925.365694:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510400 00000100:00100000:1.0:1787841925.365712:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510400 00000100:00100000:1.0:1787841925.365769:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510144 00000100:00100000:1.0:1787841925.365772:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510144 00000100:00080000:3.0:1787841925.365895:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841925.365924:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510272 00000100:00100000:3.0:1787841925.365928:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510272 00000100:00100000:3.0:1787841925.365958:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787841925.365967:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877510272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.366026:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877510272:12345-0@lo:400:kworker.0 Request processed in 61us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841925.366033:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1787841925.366074:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841925.366099:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877510272:0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.366144:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841925.366152:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877510400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841925.366187:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877510400:12345-0@lo:400:kworker.0 Request processed in 37us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841925.366193:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787841925.366390:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841925.366397:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486735e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877510144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841925.366432:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486735e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877510144:12345-0@lo:400:kworker.0 Request processed in 37us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841925.366438:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841925.366487:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877510144:0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.369036:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877509760 00000100:00100000:0.0:1787841925.369072:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877509760 00000100:00100000:0.0:1787841925.369150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787841925.369160:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877509760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841925.369241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877509760:12345-0@lo:400:kworker.0 Request processed in 82us (3904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841925.369248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00010000:00080000:0.0:1787841925.369312:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf904f00 x1874687877510400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841925.369325:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf904f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877510400:0@lo:400:kworker.0 00000100:00100000:1.0:1787841925.369722:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877509760:0@lo:400:kworker.0 00000100:00080000:3.0:1787841925.371341:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787841925.620417:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841925.874060:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841925.874083:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877510528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841925.874150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841925.874286:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510528 00000100:00100000:2.0:1787841925.874294:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510528 00000100:00100000:2.0:1787841925.874350:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787841925.874362:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877510528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841925.874398:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841925.874488:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877510528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841925.874506:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787841925.875137:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946382352d00 x1874687877510528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841925.875157:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877510528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841926.386258:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486734b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877510656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841926.386348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841926.386482:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510656 00000100:00100000:3.0:1787841926.386498:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510656 00000100:00100000:3.0:1787841926.386555:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787841926.386566:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877510656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841926.386605:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841926.386652:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877510656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841926.386659:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787841926.387061:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486734b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877510656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841926.641697:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841927.665811:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841928.467719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841928.467763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841928.467792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598528 00000100:00100000:3.0:1787841928.467803:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598528 00000100:00100000:3.0:1787841928.467861:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 285 00000100:00100000:3.0:1787841928.467872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858598528:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841928.467939:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858598528:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841928.467948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 285 00000100:00100000:3.0:1787841928.467978:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598784 00000100:00100000:3.0:1787841928.467990:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598784 00000100:00100000:3.0:1787841928.468037:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00100000:3.0:1787841928.468045:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858598784:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841928.468091:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858598784:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841928.468098:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00080000:3.0:1787841928.468226:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841928.494321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841928.494364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841928.494413:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598656 00000100:00100000:3.0:1787841928.494423:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598656 00000100:00100000:3.0:1787841928.494521:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858598912 00000100:00100000:3.0:1787841928.494525:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858598912 00000100:00100000:3.0:1787841928.494554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 126 00000100:00100000:3.0:1787841928.494564:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858598656:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841928.495423:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858598656:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 856us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841928.495435:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 126 00000100:00100000:3.0:1787841928.495489:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 127 00000100:00100000:3.0:1787841928.495500:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486737840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858598912:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841928.495531:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486737840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858598912:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 34us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841928.495538:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 127 00000100:00080000:3.0:1787841928.495567:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841928.691093:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841929.713811:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841929.972331:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787841930.481765:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877511168:0@lo:400:kworker.0 00000100:00100000:1.0:1787841930.481839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841930.481870:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511168 00000100:00100000:2.0:1787841930.481879:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511168 00000100:00100000:1.0:1787841930.481920:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787841930.481930:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877510784:0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.481941:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787841930.481952:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877511168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841930.481966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841930.481995:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a741a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877511296:0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.482034:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877511168:12345-0@lo:400:kworker.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841930.482036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841930.482047:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787841930.482074:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510784 00000100:00100000:2.0:1787841930.482079:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510784 00000100:00100000:1.0:1787841930.482080:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877511168:0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.482108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787841930.482130:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.482174:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877510784:12345-0@lo:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841930.482181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787841930.482202:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9954780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877510912:0@lo:400:kworker.0 00000100:00100000:3.0:1787841930.482227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787841930.482228:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841930.482250:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a7403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877511424:0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.482258:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511296 00000100:00100000:2.0:1787841930.482263:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511296 00000100:00100000:3.0:1787841930.482275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841930.482298:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841930.482302:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877510912 00000100:00100000:2.0:1787841930.482307:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877510912 00000100:00100000:3.0:1787841930.482316:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877511040:0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.482329:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787841930.482338:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877511296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841930.482340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841930.482362:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511040 00000100:00100000:3.0:1787841930.482366:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511040 00000100:00100000:2.0:1787841930.482386:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877511296:12345-0@lo:400:kworker.0 Request processed in 49us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841930.482388:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787841930.482400:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787841930.482409:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486735a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877510912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.482415:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787841930.482423:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486735680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877511040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787841930.482787:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841930.482909:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486735a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877510912:12345-0@lo:400:kworker.0 Request processed in 512us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841930.482914:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787841930.482937:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9954780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877510912:0@lo:400:kworker.0 00000100:00100000:2.0:1787841930.483384:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486735680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877511040:12345-0@lo:400:kworker.0 Request processed in 960us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841930.483393:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787841930.483657:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877510784:0@lo:400:kworker.0 00000100:00100000:0.0:1787841930.483670:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a741a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877511296:0@lo:400:kworker.0 00000100:00100000:1.0:1787841930.483855:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511424 00000100:00100000:1.0:1787841930.483872:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511424 00000100:00100000:1.0:1787841930.483925:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841930.483934:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486734b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877511424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841930.483983:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486734b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877511424:12345-0@lo:400:kworker.0 Request processed in 51us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841930.483989:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787841930.484566:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841930.486054:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877511040:0@lo:400:kworker.0 00010000:00080000:3.0:1787841930.486080:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a7403c0 x1874687877511424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841930.486092:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a7403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877511424:0@lo:400:kworker.0 00010000:00010000:1.0:1787841930.737664:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841930.996612:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841930.996645:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a7421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877511552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841930.996723:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841930.997293:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511552 00000100:00100000:1.0:1787841930.997319:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511552 00000100:00100000:1.0:1787841930.997376:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787841930.997387:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877511552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841930.997433:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1787841930.998336:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a7421c0 x1874687877511552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841930.998365:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a7421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877511552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841931.000883:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877511552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841931.000897:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787841931.505907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464867352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877511680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841931.505986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841931.506287:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511680 00000100:00100000:3.0:1787841931.506309:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511680 00000100:00100000:3.0:1787841931.506362:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787841931.506371:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877511680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841931.506405:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841931.506505:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877511680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841931.506512:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787841931.506641:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464867352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877511680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841931.763025:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841932.785731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841933.588632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841933.588682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841933.588944:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599168 00000100:00100000:0.0:1787841933.588953:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599168 00000100:00100000:0.0:1787841933.589025:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 131 00000100:00100000:0.0:1787841933.589044:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486736940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858599168:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841933.589126:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486736940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858599168:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 85us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841933.589151:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 131 00000100:00100000:1.0:1787841933.589222:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599040 00000100:00100000:1.0:1787841933.589227:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599040 00000100:00100000:1.0:1787841933.589262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 287 00000100:00100000:1.0:1787841933.589270:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858599040:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841933.589299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858599040:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841933.589304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 287 00000100:00080000:2.0:1787841933.590047:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841933.614670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841933.614722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841933.614809:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599296 00000100:00100000:2.0:1787841933.614818:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599296 00000100:00100000:2.0:1787841933.614897:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:2.0:1787841933.614908:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2345:x1874687858599296:12345-192.168.202.46@tcp:9:kworker.0 00000020:00000080:2.0:1787841933.614956:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e136069 00000100:00080000:2.0:1787841933.614967:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9464b7fc3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787841933.615010:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787841933.615320:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+2:2345:x1874687858599296:12345-192.168.202.46@tcp:9:kworker.0 Request processed in 413us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841933.615328:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00080000:3.0:1787841933.615719:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841933.616403:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599424 00000100:00100000:0.0:1787841933.616427:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599424 00010000:00010000:2.0:1787841933.627375:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787841933.628494:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841933.629997:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 132 00000100:00100000:0.0:1787841933.630022:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858599424:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841933.630238:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858599424:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 229us (15514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841933.630246:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 132 00010000:00010000:2.0:1787841933.809796:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841934.838242:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841935.602727:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877511808:0@lo:400:kworker.0 00000100:00100000:2.0:1787841935.602812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841935.602890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511808 00000100:00100000:3.0:1787841935.602902:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511808 00000100:00100000:3.0:1787841935.602957:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787841935.602968:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877511808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603250:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf904f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877512064:0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841935.603318:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841935.603324:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877511936:0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841935.603372:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512064 00000100:00100000:1.0:1787841935.603376:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512064 00000100:00100000:1.0:1787841935.603433:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877511936 00000100:00100000:1.0:1787841935.603436:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877511936 00000100:00100000:1.0:1787841935.603452:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787841935.603481:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877512064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603516:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877512064:12345-0@lo:400:kworker.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841935.603539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787841935.603554:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787841935.603559:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877511936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603581:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877511936:12345-0@lo:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841935.603586:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787841935.603616:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877511936:0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603625:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf904f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877512064:0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603847:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877512192:0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841935.603905:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512192 00000100:00100000:1.0:1787841935.603908:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512192 00000100:00100000:1.0:1787841935.603934:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841935.603940:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877512192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.603970:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877512192:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841935.603976:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841935.604169:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877512192:0@lo:400:kworker.0 00000100:00080000:1.0:1787841935.604209:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841935.604214:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841935.606635:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877511808:12345-0@lo:400:kworker.0 Request processed in 3662us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841935.606650:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787841935.606676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877512448:0@lo:400:kworker.0 00000100:00100000:0.0:1787841935.606729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841935.606781:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512448 00000100:00100000:3.0:1787841935.606788:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512448 00000100:00100000:1.0:1787841935.606892:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841935.606901:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841935.606904:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877512320:0@lo:400:kworker.0 00000100:00100000:3.0:1787841935.606914:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf906580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877512448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.606938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841935.606972:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512320 00000100:00100000:3.0:1787841935.606978:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf906580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877512448:12345-0@lo:400:kworker.0 Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841935.606985:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841935.606990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512320 00010000:00080000:3.0:1787841935.607045:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bf9043c0 x1874687877512448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841935.607066:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877512448:0@lo:400:kworker.0 00000100:00080000:0.0:1787841935.607274:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841935.607279:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841935.610711:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877511808:0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.610883:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787841935.610896:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877512320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841935.611027:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877512320:12345-0@lo:400:kworker.0 Request processed in 135us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841935.611036:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787841935.615435:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877512320:0@lo:400:kworker.0 00010000:00010000:0.0:1787841935.857785:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841936.116157:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877512576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841936.116245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841936.116322:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512576 00000100:00100000:2.0:1787841936.116329:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512576 00000100:00100000:2.0:1787841936.116405:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787841936.116415:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877512576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841936.116451:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841936.116526:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877512576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841936.116534:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787841936.116576:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648a740000 x1874687877512576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841936.116613:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877512576:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787841936.153715:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:3.0:1787841936.153726:0:6718:0:(genops.c:885:class_export_put()) final put ffff9464b7fc2000/7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:0.0:1787841936.153803:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b7fc2000/7142e368-78a3-4f67-bb12-5e4ed629eb65 for lustre-OST0000 00000020:00000080:0.0:1787841936.153871:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464b7fc3800 for lustre-OST0000 00000100:00100000:3.0:1787841936.626079:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877512704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841936.626175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841936.626257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512704 00000100:00100000:3.0:1787841936.626266:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512704 00000100:00100000:3.0:1787841936.626313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787841936.626322:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877512704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841936.626356:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841936.626432:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877512704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841936.626440:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787841936.626509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877512704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841936.882843:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841937.907257:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841938.705061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841938.705604:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599552 00000100:00100000:1.0:1787841938.705616:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599552 00000100:00100000:1.0:1787841938.705687:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 289 00000100:00100000:1.0:1787841938.705698:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858599552:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841938.705779:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858599552:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 83us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841938.705787:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 289 00000100:00100000:1.0:1787841938.711921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841938.713153:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599680 00000100:00100000:3.0:1787841938.713180:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599680 00000100:00100000:3.0:1787841938.713274:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 136 00000100:00100000:3.0:1787841938.713285:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858599680:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841938.713390:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858599680:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 107us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841938.713398:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 136 00000100:00080000:0.0:1787841938.713664:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841938.741850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841938.742417:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599808 00000100:00100000:1.0:1787841938.742431:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599808 00000100:00100000:1.0:1787841938.742548:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 137 00000100:00100000:1.0:1787841938.742560:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858599808:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841938.742663:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858599808:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 104us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841938.742670:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 137 00000100:00080000:2.0:1787841938.742961:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841938.933297:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841939.187647:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787841939.965417:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841940.729643:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877512832:0@lo:400:kworker.0 00000100:00100000:1.0:1787841940.729716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841940.729765:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877513344:0@lo:400:kworker.0 00000100:00100000:1.0:1787841940.729792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841940.729829:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841940.729835:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877513216:0@lo:400:kworker.0 00000100:00100000:1.0:1787841940.729872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841940.729908:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513216 00000100:00100000:1.0:1787841940.729915:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513216 00000100:00100000:1.0:1787841940.729981:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841940.729991:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877513216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841940.730046:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877513216:12345-0@lo:400:kworker.0 Request processed in 56us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841940.730053:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841940.730093:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877513216:0@lo:400:kworker.0 00000100:00100000:3.0:1787841940.730571:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512832 00000100:00100000:3.0:1787841940.730584:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512832 00000100:00100000:3.0:1787841940.730636:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787841940.730644:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877512832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841940.730687:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877512832:12345-0@lo:400:kworker.0 Request processed in 45us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841940.730693:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787841940.730720:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513344 00000100:00100000:3.0:1787841940.730724:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513344 00000100:00100000:3.0:1787841940.730754:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787841940.730779:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877513344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841940.730812:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877513344:12345-0@lo:400:kworker.0 Request processed in 52us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841940.730819:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787841940.730851:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877512832:0@lo:400:kworker.0 00000100:00100000:3.0:1787841940.730863:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877513344:0@lo:400:kworker.0 00000100:00100000:2.0:1787841940.732634:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877512960:0@lo:400:kworker.0 00000100:00100000:2.0:1787841940.732702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841940.732736:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877513472:0@lo:400:kworker.0 00000100:00100000:2.0:1787841940.732758:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841940.732780:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841940.732786:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877513088:0@lo:400:kworker.0 00000100:00100000:2.0:1787841940.732805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787841940.732833:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841940.732840:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841940.733202:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877512960 00000100:00100000:2.0:1787841940.733211:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877512960 00000100:00100000:2.0:1787841940.740005:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513088 00000100:00100000:2.0:1787841940.740026:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513088 00000100:00080000:1.0:1787841940.740134:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841940.740427:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787841940.740442:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877512960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841940.740599:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877512960:12345-0@lo:400:kworker.0 Request processed in 162us (7896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841940.740615:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787841940.740640:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787841940.740667:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877513088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841940.740698:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877513088:12345-0@lo:400:kworker.0 Request processed in 33us (7892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841940.740704:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787841940.740728:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513472 00000100:00100000:0.0:1787841940.740733:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513472 00000100:00100000:0.0:1787841940.740784:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787841940.740790:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877513472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841940.740823:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877513472:12345-0@lo:400:kworker.0 Request processed in 34us (8064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841940.740829:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787841940.747134:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841940.752297:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877513088:0@lo:400:kworker.0 00000100:00100000:0.0:1787841940.752314:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c9121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877512960:0@lo:400:kworker.0 00010000:00080000:0.0:1787841940.752327:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b98e8b40 x1874687877513472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841940.752339:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877513472:0@lo:400:kworker.0 00010000:00010000:2.0:1787841940.980507:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841941.236499:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877513600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841941.236575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841941.238115:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513600 00000100:00100000:1.0:1787841941.238132:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513600 00000100:00100000:1.0:1787841941.238213:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787841941.238224:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877513600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841941.238262:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841941.238330:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877513600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841941.238337:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787841941.238395:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649fcb2580 x1874687877513600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841941.238414:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877513600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841941.745972:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877513728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841941.746046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841941.746250:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513728 00000100:00100000:3.0:1787841941.746259:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513728 00000100:00100000:3.0:1787841941.746313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787841941.746322:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf9043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877513728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841941.746367:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841941.746413:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf9043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877513728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841941.746432:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787841941.747004:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877513728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841942.001740:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841943.037140:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841943.519351:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:45:42 (1787841942) 00000100:00100000:3.0:1787841943.825173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841943.825216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841943.825267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841943.825352:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600192 00000100:00100000:2.0:1787841943.825363:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600192 00000100:00100000:0.0:1787841943.825363:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600064 00000100:00100000:0.0:1787841943.825367:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600064 00000100:00100000:1.0:1787841943.825431:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858599936 00000100:00100000:0.0:1787841943.825449:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 141 00000100:00100000:1.0:1787841943.825450:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858599936 00000100:00100000:0.0:1787841943.825485:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858600064:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841943.825524:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 291 00000100:00100000:1.0:1787841943.825530:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858599936:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841943.825625:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858600064:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 166us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841943.825633:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 141 00000100:00100000:2.0:1787841943.826118:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 142 00000100:00100000:2.0:1787841943.826129:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858600192:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841943.826229:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858599936:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 697us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841943.826237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 291 00000100:00100000:2.0:1787841943.840060:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858600192:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 13910us (14819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841943.840096:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 142 00000100:00080000:3.0:1787841943.842625:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841944.049963:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841945.074198:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841945.275776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841945.276092:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600320 00000100:00100000:0.0:1787841945.276105:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600320 00000100:00100000:0.0:1787841945.276185:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:0.0:1787841945.276197:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:10230:x1874687858600320:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841945.276220:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841945.276278:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a61 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.276366:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e13613b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.276381:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e13613b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.276393:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e13613b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841945.276657:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841945.276661:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:3.0:1787841945.277346:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1787841945.277394:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e13613b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.277431:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a61 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.277494:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e13613b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a61 expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.277504:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b900) 00010000:00010000:0.0:1787841945.277507:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841945.277510:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464829dca00, rc 0) 00000100:00100000:0.0:1787841945.277683:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:10230:x1874687858600320:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 1488us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841945.277692:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:1.0:1787841945.286543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841945.290700:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600448 00000100:00100000:3.0:1787841945.290718:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600448 00000100:00100000:3.0:1787841945.291039:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:3.0:1787841945.291052:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:10231:x1874687858600448:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841945.291075:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841945.291097:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.291164:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.291181:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.291193:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.291207:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.291214:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.291221:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.292245:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e136157 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.292270:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e136157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.292278:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e136157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841945.292378:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787841945.292382:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841945.293672:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e136157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.293691:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.293698:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.293705:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.293712:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841945.293717:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.293724:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.293739:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b900) 00010000:00010000:3.0:1787841945.293742:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841945.293747:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294672:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294691:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294698:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294705:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294711:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841945.294715:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294723:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294733:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9464999d2100) 00010000:00010000:3.0:1787841945.294736:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841945.294739:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294745:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294804:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a68 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294819:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e136157 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a68 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841945.294833:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9464999d2500) 00010000:00010000:3.0:1787841945.294836:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841945.294839:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030e00, rc 0) 00000100:00100000:3.0:1787841945.295057:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:10231:x1874687858600448:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 4006us (8521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841945.295066:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:1.0:1787841945.305659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841945.305956:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600704 00000100:00100000:0.0:1787841945.305966:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600704 00000100:00100000:0.0:1787841945.306034:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:0.0:1787841945.306044:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:10231:x1874687858600704:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841945.306067:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841945.306089:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e13615e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a6f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.306166:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.306180:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.306192:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.306227:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.306248:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.306254:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.309673:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480600/0x1d0ed3605e136173 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.309695:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480600/0x1d0ed3605e136173 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.309706:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480600/0x1d0ed3605e136173 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841945.309721:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787841945.310256:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310265:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310271:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310277:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841945.310281:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310288:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310325:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9464999d2500) 00010000:00010000:0.0:1787841945.310328:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841945.310333:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310340:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dd200/0x1d0ed3605e136165 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310357:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310364:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310369:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310374:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dde00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841945.310377:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310382:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310389:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94648391b500) 00010000:00010000:0.0:1787841945.310392:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841945.310394:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.310400:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dde00/0x1d0ed3605e13616c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.311031:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dc600/0x1d0ed3605e13615e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a6f expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.311052:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480600/0x1d0ed3605e136173 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a6f expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841945.311060:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:0.0:1787841945.311062:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841945.311064:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480600, rc 0) 00000100:00100000:0.0:1787841945.311141:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:10231:x1874687858600704:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 5097us (5491us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787841945.311151:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:1.0:1787841945.319194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841945.319295:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600832 00000100:00100000:2.0:1787841945.319314:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600832 00000100:00100000:2.0:1787841945.319425:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:2.0:1787841945.319436:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:10231:x1874687858600832:12345-192.168.202.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787841945.319574:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:10231:x1874687858600832:12345-192.168.202.46@tcp:59:lhsmtool_posix.0 Request processed in 140us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841945.319582:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 35 00000040:00080000:0.0:1787841945.330047:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787841945.842736:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877513856:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.842809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841945.842854:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877514368:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.842880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841945.842904:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841945.842923:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877514240:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.842949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841945.842980:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877513984:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841945.843022:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877514496:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843042:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841945.843060:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841945.843066:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877514112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841945.843122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513856 00000100:00100000:1.0:1787841945.843130:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513856 00000100:00100000:1.0:1787841945.843178:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787841945.843209:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877513856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843259:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877513856:12345-0@lo:400:kworker.0 Request processed in 52us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841945.843267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787841945.843310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877514368 00000100:00100000:1.0:1787841945.843314:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877514368 00000100:00100000:1.0:1787841945.843350:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877513984 00000100:00100000:1.0:1787841945.843354:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877513984 00000100:00100000:1.0:1787841945.843367:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877514112 00000100:00100000:1.0:1787841945.843370:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877514112 00000100:00100000:1.0:1787841945.843386:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787841945.843393:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877514368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843424:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877514368:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841945.843431:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787841945.843442:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787841945.843448:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877513984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843504:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877513984:12345-0@lo:400:kworker.0 Request processed in 56us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841945.843509:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787841945.843522:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787841945.843528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877514112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843554:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877514112:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841945.843559:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787841945.843578:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877514240 00000100:00100000:1.0:1787841945.843581:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877514240 00000100:00100000:1.0:1787841945.843612:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877514496 00000100:00100000:1.0:1787841945.843615:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877514496 00000100:00100000:1.0:1787841945.843631:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787841945.843637:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877514240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843666:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877514240:12345-0@lo:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841945.843671:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787841945.843681:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841945.843687:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877514496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843712:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877514496:12345-0@lo:400:kworker.0 Request processed in 26us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841945.843717:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787841945.843746:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841945.843750:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841945.843752:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841945.843787:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877514112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843798:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877513984:0@lo:400:kworker.0 00010000:00080000:1.0:1787841945.843810:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649fcb1e00 x1874687877514496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841945.843819:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877514496:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843851:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877514240:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843859:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877513856:0@lo:400:kworker.0 00000100:00100000:1.0:1787841945.843867:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877514368:0@lo:400:kworker.0 00000001:00080000:2.0:1787841945.952363:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1787841946.098825:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841946.353713:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877514624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841946.353807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841946.355156:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877514624 00000100:00100000:3.0:1787841946.355167:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877514624 00000100:00100000:3.0:1787841946.355218:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787841946.355228:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877514624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841946.355266:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841946.355352:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877514624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841946.355360:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787841946.355563:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649fcb0000 x1874687877514624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841946.355584:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877514624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841946.866532:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841946.866582:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877514752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841946.866660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841946.866764:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877514752 00000100:00100000:0.0:1787841946.866774:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877514752 00000100:00100000:0.0:1787841946.866817:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841946.866826:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877514752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841946.866859:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841946.866967:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877514752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841946.866975:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841946.867025:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877514752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841947.125973:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841947.246399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841947.247063:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858600960 00000100:00100000:0.0:1787841947.247078:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858600960 00000100:00100000:0.0:1787841947.248146:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:0.0:1787841947.248167:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:10273:x1874687858600960:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841947.248187:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841947.248207:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841947.248329:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841947.249667:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.249688:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.249700:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.249715:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.249722:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.249728:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251138:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251150:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251157:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251174:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841947.251178:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251186:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251200:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b900) 00010000:00010000:0.0:1787841947.251204:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841947.251208:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251214:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251541:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251548:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251552:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251556:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841947.251558:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251565:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251584:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94648391b600) 00010000:00010000:0.0:1787841947.251587:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841947.251591:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251596:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13618f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251643:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136181 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a76 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251654:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b900) 00010000:00010000:0.0:1787841947.251656:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841947.251659:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a76 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.251669:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841947.253592:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:10273:x1874687858600960:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5417us (7193us total) trans 0 rc 301/301 00000100:00100000:0.0:1787841947.253605:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:1.0:1787841947.259909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.260013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858601216 00000100:00100000:3.0:1787841947.260023:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858601216 00000100:00100000:3.0:1787841947.260088:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:3.0:1787841947.260098:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:10273:x1874687858601216:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:3.0:1787841947.260160:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841947.260188:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464829dca00/0x1d0ed3605e13613b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a61 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.260209:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b900) 00010000:00010000:3.0:1787841947.260221:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841947.260541:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.260557:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.260564:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.260573:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.260580:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.260587:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841947.261352:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787841947.261363:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.261372:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.261378:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.261384:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841947.261388:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.261395:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.261416:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9464999d2100) 00010000:00010000:3.0:1787841947.261419:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841947.261424:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.261430:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136196 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841947.261445:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4b80cf0 reply state 0000000022af24f8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841947.261454:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841947.263019:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:10273:x1874687858601216:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 2916us (3115us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787841947.263029:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 37 00010000:00010000:3.0:1787841947.264812:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.264829:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.264837:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.264844:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841947.264848:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.264857:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.264890:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9464999d2800) 00010000:00010000:3.0:1787841947.264894:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841947.265017:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.265025:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13619d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841947.337147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841947.337216:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858601344 00000100:00100000:2.0:1787841947.337320:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858601344 00000100:00100000:2.0:1787841947.337433:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:2.0:1787841947.337443:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:10281:x1874687858601344:12345-192.168.202.46@tcp:101:lctl.0 00010000:00010000:2.0:1787841947.337505:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841947.337531:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a7d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.337764:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1361ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.337779:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1361ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.337791:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1361ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841947.337849:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787841947.337853:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841947.337889:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1361ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.337966:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a7d expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.337985:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1361ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a7d expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.337994:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:3.0:1787841947.337998:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841947.338015:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031000, rc 0) 00000100:00100000:3.0:1787841947.338102:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:10281:x1874687858601344:12345-192.168.202.46@tcp:101:lctl.0 Request processed in 661us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841947.338107:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:1.0:1787841947.399359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841947.399592:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858601472 00000100:00100000:2.0:1787841947.399616:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858601472 00000100:00100000:2.0:1787841947.399681:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:2.0:1787841947.399691:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:10287:x1874687858601472:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787841947.399712:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841947.399733:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1361b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a84 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.399812:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.399826:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.399838:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.399852:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.399858:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.399865:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400354:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e1361c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400364:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e1361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400372:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e1361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841947.400412:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787841947.400416:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841947.400549:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e1361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400563:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400569:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400576:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400583:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfe00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841947.400587:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400595:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400608:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841947.400611:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841947.400615:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400621:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1361b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400635:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400651:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400656:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400660:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841947.400663:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400669:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400675:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff946487ed3a00) 00010000:00010000:2.0:1787841947.400678:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841947.400681:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400686:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1361c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400718:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1361b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a84 expref: 11 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400731:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e1361c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a84 expref: 10 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.400738:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841947.400741:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787841947.400749:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfc00, rc 0) 00000100:00100000:2.0:1787841947.400868:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:10287:x1874687858601472:12345-192.168.202.46@tcp:101:bash.0 Request processed in 1178us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841947.400876:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:1.0:1787841947.406018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841947.406146:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858601728 00000100:00100000:0.0:1787841947.406158:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858601728 00000100:00100000:0.0:1787841947.406237:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:0.0:1787841947.406249:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:10287:x1874687858601728:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841947.406271:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841947.406306:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1361ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a8b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.406835:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.406852:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.406863:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.406907:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.406916:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.406924:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841947.407859:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787841947.408150:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408163:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408173:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408214:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408318:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408325:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408331:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841947.408336:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408343:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408356:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:0.0:1787841947.408359:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841947.408364:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408370:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1361d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841947.408388:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7b1f13d reply state 000000001949ae9e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841947.408398:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787841947.408436:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1361ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408756:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.408776:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841947.408778:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841947.408780:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481000, rc 0) 00000100:00100000:0.0:1787841947.408864:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10287:x1874687858601728:12345-192.168.202.46@tcp:101:bash.0 Request processed in 2617us (2923us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787841947.408872:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 40 00010000:00010000:3.0:1787841947.413518:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.413535:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.413542:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.413547:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841947.413552:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.413560:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.413577:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648391b600) 00010000:00010000:3.0:1787841947.413581:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841947.413585:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.413591:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1361dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841947.415546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.415922:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858601856 00000100:00100000:3.0:1787841947.415932:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858601856 00000100:00100000:3.0:1787841947.415979:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:3.0:1787841947.415987:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874687858601856:12345-192.168.202.46@tcp:8:bash.0 00010000:00080000:3.0:1787841947.416033:0:6691:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:3.0:1787841947.416071:0:6691:0:(genops.c:1385:class_connect()) connect: client 7142e368-78a3-4f67-bb12-5e4ed629eb65, cookie 0x1d0ed3605e1361f1 00002000:00100000:3.0:1787841947.416083:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7142e368-78a3-4f67-bb12-5e4ed629eb65/ffff946381279800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787841947.416094:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787841947.416346:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787841947.416377:0:6691:0:(import.c:65:import_set_state_nolock()) ffff946381279000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841947.416525:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2345:x1874687858601856:12345-192.168.202.46@tcp:8:bash.0 Request processed in 538us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841947.416534:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:0.0:1787841947.431708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.431987:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858601984 00000100:00100000:1.0:1787841947.432000:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858601984 00000100:00100000:1.0:1787841947.432119:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:1.0:1787841947.432131:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:0:x1874687858601984:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841947.432153:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841947.432179:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a92 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787841947.432214:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.432251:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1787841947.432256:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.432266:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.432298:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.432313:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247400, rc 0) 00000100:00100000:1.0:1787841947.432394:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:0:x1874687858601984:12345-192.168.202.46@tcp:101:bash.0 Request processed in 265us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.433822:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00080000:3.0:1787841947.437831:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841947.438101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841947.438188:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858602112 00000100:00100000:0.0:1787841947.438198:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858602112 00000100:00100000:0.0:1787841947.438269:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:0.0:1787841947.438279:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:10287:x1874687858602112:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841947.438309:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841947.438334:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97a99 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.438371:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.438381:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.438385:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.438391:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.438441:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.438507:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 8 pid: 6693 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841947.438523:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf9052c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874687877514880:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841947.438622:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841947.441947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.442189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858602240 00000100:00100000:3.0:1787841947.442199:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858602240 00010000:00010000:3.0:1787841947.442248:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 9 pid: 6693 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841947.442294:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:3.0:1787841947.442304:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2348:x1874687858602240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841947.442320:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841947.442343:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 9 pid: 6693 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.442358:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 9 pid: 6693 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.442385:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841947.442411:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841947.442419:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.442431:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.442489:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841947.442503:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd943c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874687877515008:192.168.202.46@tcp:105: 00000100:00100000:3.0:1787841947.442584:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648b38c840 going to sleep for 11 seconds 00010000:00010000:0.0:1787841947.444595:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000260a11e6/0x1d0ed3605e1361f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a92 expref: 9 pid: 6693 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841947.444621:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf9052c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874687877514880:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841947.444653:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.444667:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841947.444730:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:10287:x1874687858602112:12345-192.168.202.46@tcp:101:bash.0 Request processed in 6452us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841947.444739:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:0.0:1787841947.446711:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd943c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874687877515008:192.168.202.46@tcp:105: 00010000:00010000:0.0:1787841947.446737:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841947.446814:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858602240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4510us (4875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841947.446826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:3.0:1787841947.452374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.452637:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858602496 00000100:00100000:1.0:1787841947.452648:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858602496 00000100:00100000:1.0:1787841947.452707:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:1.0:1787841947.452718:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:10287:x1874687858602496:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:1.0:1787841947.453112:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10287:x1874687858602496:12345-192.168.202.46@tcp:35:bash.0 Request processed in 395us (749us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787841947.453120:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:3.0:1787841947.543081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.543184:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858602752 00000100:00100000:1.0:1787841947.543194:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858602752 00000100:00100000:1.0:1787841947.543269:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:1.0:1787841947.543307:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10297:x1874687858602752:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841947.543339:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841947.543363:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136206 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97aa0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841947.543536:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787841947.543661:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136206 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aa0 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.543675:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:1.0:1787841947.543678:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841947.543683:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136206 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aa0 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.543709:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247c00, rc 0) 00000100:00100000:1.0:1787841947.543779:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:10297:x1874687858602752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 501us (706us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787841947.543786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:2.0:1787841947.553965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.554082:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858603008 00000100:00100000:1.0:1787841947.554091:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858603008 00000100:00100000:1.0:1787841947.554140:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:1.0:1787841947.554148:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:10297:x1874687858603008:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841947.554631:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:10297:x1874687858603008:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 481us (674us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787841947.554639:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:3.0:1787841947.631921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.632025:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858603136 00000100:00100000:1.0:1787841947.632037:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858603136 00000100:00100000:1.0:1787841947.632092:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:1.0:1787841947.632102:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:10303:x1874687858603136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841947.632125:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841947.632143:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97aa7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.632206:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13621b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.632230:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13621b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.632240:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13621b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841947.632320:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787841947.632324:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841947.632346:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13621b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.632371:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aa7 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.632388:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13621b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aa7 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.632407:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841947.632410:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841947.632414:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246200, rc 0) 00000100:00100000:1.0:1787841947.632519:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:10303:x1874687858603136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 418us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.632527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:0.0:1787841947.637172:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.637327:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858603392 00000100:00100000:1.0:1787841947.637337:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858603392 00000100:00100000:1.0:1787841947.637403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:1.0:1787841947.637414:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf9052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:10303:x1874687858603392:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841947.637435:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841947.637477:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97aae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.637578:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.637610:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.637622:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841947.637635:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841947.638024:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aae expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.638043:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aae expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.638052:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:1.0:1787841947.638054:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841947.638058:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247a00, rc 0) 00000100:00100000:1.0:1787841947.638122:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf9052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:10303:x1874687858603392:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 710us (961us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787841947.638129:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:2.0:1787841947.641529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841947.641617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858603520 00000100:00100000:0.0:1787841947.641641:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858603520 00000100:00100000:0.0:1787841947.641705:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:0.0:1787841947.641716:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2347:x1874687858603520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841947.641732:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841947.641774:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aae expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.641793:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841947.641797:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841947.641855:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:2347:x1874687858603520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 141us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841947.641863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:3.0:1787841947.645797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.645941:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858603776 00000100:00100000:1.0:1787841947.645951:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858603776 00000100:00100000:1.0:1787841947.646013:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:1.0:1787841947.646023:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:10303:x1874687858603776:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841947.646048:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841947.646074:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136237 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ab5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.646205:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13623e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.646235:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13623e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.646245:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13623e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841947.646258:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841947.646430:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ab5 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.646450:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13623e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ab5 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.646492:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:1.0:1787841947.646495:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787841947.646498:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247000, rc 0) 00000100:00100000:1.0:1787841947.646873:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10303:x1874687858603776:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 850us (1085us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787841947.646882:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:3.0:1787841947.653683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841947.653797:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858603904 00000100:00100000:0.0:1787841947.653807:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858603904 00000100:00100000:0.0:1787841947.653861:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:0.0:1787841947.653870:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858603904:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1787841947.653929:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.653948:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.653958:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.653962:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841947.653967:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.654020:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.654034:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841947.654050:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874687877515136:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841947.654142:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841947.658139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.658237:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858604032 00000100:00100000:3.0:1787841947.658247:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858604032 00002000:00100000:3.0:1787841947.658302:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9464b980d680 x1874687858604032/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:448/0 lens 504/0 e 0 to 0 dl 1787841958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841947.658313:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b980d680 with x1874687858604032 ext(0->12) 00010000:00010000:3.0:1787841947.658322:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 8 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.658338:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 8 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841947.658364:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9464b980d680 00000100:00100000:3.0:1787841947.658414:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:3.0:1787841947.658425:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858604032:12345-192.168.202.46@tcp:4:lfs.0 00000100:00100000:0.0:1787841947.659978:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874687877515136:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841947.660006:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787841947.702340:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000001:00080000:1.0:1787841947.738186:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1787841947.738822:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858604032:12345-192.168.202.46@tcp:4:lfs.0 Request processed in 80392us (80685us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787841947.738841:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00002000:00100000:2.0:1787841947.738857:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9464b980d680 x1874687858604032/t4294967299(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:448/0 lens 504/448 e 0 to 0 dl 1787841958 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841947.738868:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b980d680 with x1874687858604032 ext(0->12) 00010000:00010000:2.0:1787841947.738888:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.738909:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841947.738918:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9464b980d680 00000100:00100000:3.0:1787841947.742005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.742632:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858604160 00000100:00100000:1.0:1787841947.742643:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858604160 00010000:00010000:1.0:1787841947.742686:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841947.742889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:1.0:1787841947.742911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858604160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841947.742929:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787841947.742953:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787841947.742957:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787841948 00002000:00010000:1.0:1787841947.742959:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787841948 00002000:00010000:1.0:1787841947.742962:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787841948 00002000:00010000:1.0:1787841947.742964:0:5835:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787841947.742971:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.742985:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.743013:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004450c9f9/0x1d0ed3605e1361ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a99 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.743035:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841947.743041:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841947.743046:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.743057:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.743103:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841947.743161:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858604160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 252us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.743169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 36 00010000:00010000:3.0:1787841947.743224:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743235:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743257:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743266:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743274:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743291:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841947.743296:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743304:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743323:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.743331:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13624c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841947.743379:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858603904:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 89510us (89706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841947.743387:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:3.0:1787841947.747149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.747237:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858604416 00000100:00100000:1.0:1787841947.747249:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858604416 00000100:00100000:1.0:1787841947.747339:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:1.0:1787841947.747351:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10303:x1874687858604416:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:1.0:1787841947.747427:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13623e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ab5 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841947.747756:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787841947.747807:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787841947.748556:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787841947.748621:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.748641:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.748650:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.748689:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.748707:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 23 pid: 5851 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841947.748730:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874687877515264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841947.748853:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841947.753592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841947.753912:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858604544 00000100:00100000:2.0:1787841947.753922:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858604544 00010000:00010000:2.0:1787841947.753971:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 24 pid: 5851 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841947.754013:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:2.0:1787841947.754023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf905680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:2349:x1874687858604544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841947.754053:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841947.754061:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 24 pid: 5851 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.754074:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 24 pid: 5851 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.754095:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:2.0:1787841947.754101:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.754110:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.754118:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.754134:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841947.754185:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf905680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:2349:x1874687858604544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 164us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841947.754193:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 37 00010000:00010000:1.0:1787841947.754579:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1361e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a8b expref: 23 pid: 5851 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841947.754601:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874687877515264:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841947.754624:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.754633:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.754638:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841947.754770:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787841947.754979:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787841947.755111:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877515392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787841947.755159:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841947.755183:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841947.755951:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877515392 00000100:00100000:2.0:1787841947.755961:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877515392 00000100:00100000:2.0:1787841947.756028:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841947.756039:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874687877515392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841947.756146:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874687877515392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841947.756153:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787841947.756289:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841947.756357:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877515392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787841947.757291:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787841947.757370:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877515520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787841947.757420:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841947.757453:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841947.757570:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877515520 00000100:00100000:1.0:1787841947.757576:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877515520 00000100:00100000:1.0:1787841947.757608:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841947.757617:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c9121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874687877515520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787841947.757843:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c9121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874687877515520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 227us (422us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787841947.757860:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841947.758945:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877515520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787841947.759027:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787841947.759078:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.759089:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.759108:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.759115:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841947.759120:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.759129:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.759145:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841947.759149:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787841947.759154:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.759160:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136253 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841947.759361:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787841947.759620:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787841947.759635:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336734176911ns, next at 337734174344ns, rc = 0 00000001:00080000:0.0:1787841947.759641:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787841947.759674:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841947.759678:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787841947.759686:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13623e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ab5 expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841947.759817:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:10303:x1874687858604416:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 12468us (12678us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787841947.759840:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00000020:00080000:0.0:1787841947.759847:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787841947.763642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841947.763724:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858604672 00000100:00100000:2.0:1787841947.763734:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858604672 00000100:00100000:2.0:1787841947.763802:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:2.0:1787841947.763813:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c910f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:10303:x1874687858604672:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841947.763842:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841947.763866:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13625a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97abc expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.763946:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13625a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97abc expref: 27 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.763963:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13625a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97abc expref: 27 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.763983:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:2.0:1787841947.763987:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841947.763991:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841947.764051:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c910f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:10303:x1874687858604672:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 240us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841947.764059:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:2.0:1787841947.769249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.769580:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858604928 00000100:00100000:3.0:1787841947.769592:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858604928 00000100:00100000:3.0:1787841947.769647:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:3.0:1787841947.769657:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649855d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:10303:x1874687858604928:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841947.769949:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649855d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:10303:x1874687858604928:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 293us (710us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787841947.769956:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:3.0:1787841947.842702:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841947.842806:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858605184 00000100:00100000:0.0:1787841947.842817:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858605184 00000100:00100000:0.0:1787841947.842873:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:0.0:1787841947.842880:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:10313:x1874687858605184:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841947.842906:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841947.842927:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ac3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841947.843046:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787841947.843141:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136261 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ac3 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.843153:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:0.0:1787841947.843155:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841947.843159:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ac3 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.843171:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787841947.843236:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10313:x1874687858605184:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 355us (543us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787841947.843243:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:2.0:1787841947.846766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.846885:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858605312 00000100:00100000:1.0:1787841947.846894:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858605312 00000100:00100000:1.0:1787841947.846998:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:1.0:1787841947.847010:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10313:x1874687858605312:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:1.0:1787841947.847098:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847112:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847121:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847132:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847136:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847140:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847248:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847257:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847262:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841947.847340:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847353:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847359:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847366:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847372:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841947.847377:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847385:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847401:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841947.847404:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841947.847408:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847412:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13626f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847422:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847425:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847434:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847437:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841947.847439:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847443:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847447:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317a000) 00010000:00010000:1.0:1787841947.847449:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841947.847450:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847487:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847499:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847503:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847506:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847509:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841947.847510:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847521:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847526:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841947.847527:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841947.847529:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.847532:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e13627d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841947.847594:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10313:x1874687858605312:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 587us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.847599:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:2.0:1787841947.850425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.850543:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858605568 00000100:00100000:3.0:1787841947.850552:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858605568 00000100:00100000:3.0:1787841947.850659:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:3.0:1787841947.850667:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10313:x1874687858605568:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841947.850915:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+30:10313:x1874687858605568:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 248us (499us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787841947.850936:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:0.0:1787841947.874436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.874681:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858605824 00000100:00100000:1.0:1787841947.874692:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858605824 00000100:00100000:1.0:1787841947.874766:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:1.0:1787841947.874778:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+30:10316:x1874687858605824:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841947.874808:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841947.874832:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97aca expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.874925:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.874942:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.874956:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.874987:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.874995:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875001:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875151:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875161:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875168:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841947.875180:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841947.875302:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875310:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875317:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875323:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841947.875328:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875347:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875360:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841947.875363:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841947.875369:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875376:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13628b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875390:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875395:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875400:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875405:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841947.875408:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875414:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875421:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317a000) 00010000:00010000:1.0:1787841947.875423:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841947.875426:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875549:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e136292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875602:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875616:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.875623:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841947.875626:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841947.875629:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247200, rc 0) 00000100:00100000:1.0:1787841947.875817:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10316:x1874687858605824:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1041us (1392us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787841947.875824:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:2.0:1787841947.883385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841947.883651:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858605952 00000100:00100000:3.0:1787841947.883661:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858605952 00000100:00100000:3.0:1787841947.883709:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:3.0:1787841947.883719:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10316:x1874687858605952:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:3.0:1787841947.883791:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883805:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883814:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883834:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883839:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883843:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883847:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841947.883850:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883854:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883862:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841947.883877:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841947.883881:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.883886:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841947.884403:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10316:x1874687858605952:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 678us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841947.884411:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:2.0:1787841947.892887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841947.892966:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858606208 00000100:00100000:1.0:1787841947.892977:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858606208 00000100:00100000:1.0:1787841947.893046:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:1.0:1787841947.893055:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10316:x1874687858606208:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841947.893668:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:10316:x1874687858606208:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 610us (787us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787841947.893675:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00010000:00010000:0.0:1787841948.145761:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841948.149832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841948.149984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858606464 00000100:00100000:3.0:1787841948.149996:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858606464 00000100:00100000:3.0:1787841948.150126:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 50 00000100:00100000:3.0:1787841948.150140:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:10347:x1874687858606464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1787841948.150245:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841948.150269:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ad1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.150400:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e1362b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.150417:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e1362b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.150431:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e1362b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841948.150444:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787841948.150659:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1362ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad1 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.150694:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e1362b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad1 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.150702:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841948.150706:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841948.150709:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030800, rc 0) 00000100:00100000:3.0:1787841948.150780:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:10347:x1874687858606464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 643us (957us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787841948.150788:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 50 00000100:00100000:2.0:1787841948.162245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841948.162307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841948.162369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858606848 00000100:00100000:1.0:1787841948.162380:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858606848 00000100:00100000:1.0:1787841948.162534:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:1.0:1787841948.162545:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:2346:x1874687858606848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841948.162581:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841948.162609:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e1362b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad1 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.162629:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841948.162634:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841948.162679:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:2346:x1874687858606848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841948.162686:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:3.0:1787841948.163228:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858606720 00000100:00100000:3.0:1787841948.163235:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858606720 00000100:00100000:3.0:1787841948.163282:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:3.0:1787841948.163293:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:10347:x1874687858606720:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1787841948.163778:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:10347:x1874687858606720:12345-192.168.202.46@tcp:35:cat.0 Request processed in 476us (1531us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787841948.163786:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:2.0:1787841948.296201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841948.296336:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858607104 00000100:00100000:1.0:1787841948.296347:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858607104 00000100:00100000:1.0:1787841948.296415:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:1.0:1787841948.296426:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:10353:x1874687858607104:12345-192.168.202.46@tcp:101:dd.0 00010000:00010000:1.0:1787841948.296488:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841948.296493:0:8624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787841948.296523:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13621b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aa7 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.296546:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841948.296552:0:8624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841948.296568:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1362c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ad8 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.296684:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.296699:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.296718:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.296767:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.296782:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 35 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841948.296798:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877515648:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841948.296921:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841948.302084:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877515648:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841948.302117:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841948.302231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841948.303570:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858607232 00000100:00100000:0.0:1787841948.303585:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858607232 00010000:00010000:0.0:1787841948.303632:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 36 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841948.303725:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:0.0:1787841948.303737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:2348:x1874687858607232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841948.303767:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841948.303776:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 36 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841948.303790:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 36 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841948.303814:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aca expref: 36 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841948.303831:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841948.303837:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841948.304859:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841948.304874:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841948.304921:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841948.305078:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.305088:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841948.305112:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841948.305318:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1362c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 37 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.305338:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 36 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.305367:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841948.305370:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841948.305373:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246a00, rc 0) 00000100:00100000:1.0:1787841948.305479:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:10353:x1874687858607104:12345-192.168.202.46@tcp:101:dd.0 Request processed in 9033us (9274us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787841948.305489:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:0.0:1787841948.306696:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:2348:x1874687858607232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2954us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841948.306718:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:3.0:1787841948.310430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841948.310569:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858607488 00000100:00100000:1.0:1787841948.310579:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858607488 00000100:00100000:1.0:1787841948.310637:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:1.0:1787841948.310646:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:10353:x1874687858607488:12345-192.168.202.46@tcp:36:dd.0 00010000:00010000:1.0:1787841948.310944:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.310962:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.310974:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841948.311027:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787841948.311053:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e5082e0 reply state 000000005f2f2547 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841948.311068:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841948.311164:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:10353:x1874687858607488:12345-192.168.202.46@tcp:36:dd.0 Request processed in 518us (744us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787841948.311171:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 52 00000020:00080000:1.0:1787841948.311192:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841948.314712:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.314732:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.314740:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.314747:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841948.314765:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.314774:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.314791:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841948.314794:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841948.314799:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.314806:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e1362d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841948.842808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841948.843142:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858607616 00000100:00100000:1.0:1787841948.843155:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858607616 00000100:00100000:1.0:1787841948.843219:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:1.0:1787841948.843229:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:10367:x1874687858607616:12345-192.168.202.46@tcp:101:stat.0 00010000:00010000:1.0:1787841948.843254:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841948.843288:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1362df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97adf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843363:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843377:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843398:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843415:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843423:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843430:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843563:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843575:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 38 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843601:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843640:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 38 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.843655:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 38 pid: 8624 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841948.843671:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877515776:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841948.843766:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841948.856683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841948.856795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858607872 00000100:00100000:0.0:1787841948.856805:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858607872 00000100:00100000:0.0:1787841948.856872:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:0.0:1787841948.856892:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:5586:x1874687858607872:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787841948.857238:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:5586:x1874687858607872:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 356us (565us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787841948.857246:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:3.0:1787841948.857657:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877515776:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841948.857684:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841948.868613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841948.869895:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858608000 00000100:00100000:1.0:1787841948.869908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858608000 00010000:00010000:1.0:1787841948.869956:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 40 pid: 8624 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841948.870003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:1.0:1787841948.870013:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:2348:x1874687858608000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841948.870028:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841948.870035:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 40 pid: 8624 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.870048:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 40 pid: 8624 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.870089:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1362ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ad8 expref: 40 pid: 8624 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.870107:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841948.870112:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.870121:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.870130:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841948.870162:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841948.870231:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:2348:x1874687858608000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 219us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841948.870240:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00010000:00010000:3.0:1787841948.870614:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870623:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841948.870672:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787841948.870677:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841948.870722:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870737:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870773:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870779:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870784:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870790:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841948.870793:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870800:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870809:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:3.0:1787841948.870812:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841948.870816:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870821:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1362e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870834:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870840:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870844:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870855:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841948.870857:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870863:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870871:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317a000) 00010000:00010000:3.0:1787841948.870873:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841948.870876:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870892:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1362ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870933:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1362df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97adf expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870946:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97adf expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841948.870952:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841948.870954:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841948.870956:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246600, rc 0) 00000100:00100000:3.0:1787841948.870987:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:10367:x1874687858607616:12345-192.168.202.46@tcp:101:stat.0 Request processed in 27761us (28189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841948.870994:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:1.0:1787841948.954366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841948.954416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841948.954490:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858608384 00000100:00100000:1.0:1787841948.954492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841948.954499:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858608384 00000100:00100000:0.0:1787841948.954587:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 146 00000100:00100000:0.0:1787841948.954598:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858608384:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841948.954616:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858608256 00000100:00100000:3.0:1787841948.954633:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858608256 00000100:00100000:3.0:1787841948.954662:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00100000:3.0:1787841948.954669:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858608256:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841948.954676:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2349:x1874687858608384:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841948.954683:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 146 00000100:00100000:3.0:1787841948.954695:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858608256:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841948.954701:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00080000:1.0:1787841948.954767:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841948.954931:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858608128 00000100:00100000:2.0:1787841948.954935:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858608128 00000100:00100000:2.0:1787841948.954976:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 293 00000100:00100000:2.0:1787841948.954983:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858608128:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841948.955023:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858608128:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 41us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841948.955030:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 293 00000100:00100000:1.0:1787841949.001922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841949.002031:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858608640 00000100:00100000:2.0:1787841949.002042:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858608640 00000100:00100000:2.0:1787841949.002121:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 54 00000100:00100000:2.0:1787841949.002133:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:10373:x1874687858608640:12345-192.168.202.46@tcp:36:truncate.0 00010000:00010000:2.0:1787841949.002208:0:8624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841949.002237:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1362f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97adf expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.002260:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:2.0:1787841949.002278:0:8624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841949.002591:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.002606:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.002617:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841949.002673:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787841949.002715:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000294c4bd3 reply state 00000000d86a7667 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841949.002725:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841949.002839:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:10373:x1874687858608640:12345-192.168.202.46@tcp:36:truncate.0 Request processed in 707us (926us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787841949.002847:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 54 00000020:00080000:2.0:1787841949.002852:0:8624:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1787841949.003303:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841949.008865:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.008886:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.008894:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.008901:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dee00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841949.008907:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.008915:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.008934:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841949.008937:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841949.008943:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.008950:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1362fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.171302:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841949.294533:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.296527:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858608768 00000100:00100000:0.0:1787841949.296543:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858608768 00000100:00100000:0.0:1787841949.296625:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:0.0:1787841949.296636:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf905680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:10387:x1874687858608768:12345-192.168.202.46@tcp:101:stat.0 00010000:00010000:0.0:1787841949.296660:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841949.296683:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ae6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296752:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296787:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296800:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296818:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296825:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296831:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296942:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.296950:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841949.296985:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787841949.296990:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841949.297014:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297027:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297045:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297052:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297060:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297066:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841949.297071:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297078:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297090:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:0.0:1787841949.297093:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841949.297098:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297104:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297121:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297127:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297132:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.297143:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841949.297146:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.298514:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.298531:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648391b700) 00010000:00010000:0.0:1787841949.298534:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841949.298538:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.298545:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.298601:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.298617:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.298624:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841949.298626:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841949.298628:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481000, rc 0) 00000100:00100000:0.0:1787841949.298773:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf905680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:10387:x1874687858608768:12345-192.168.202.46@tcp:101:stat.0 Request processed in 2136us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841949.298782:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:0.0:1787841949.407823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841949.407950:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858609024 00000100:00100000:2.0:1787841949.407960:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858609024 00000100:00100000:2.0:1787841949.408022:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 56 00000100:00100000:2.0:1787841949.408032:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:10397:x1874687858609024:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841949.408056:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841949.408080:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e13631e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97aed expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841949.408214:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787841949.408365:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e13631e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aed expref: 42 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.408391:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841949.408395:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841949.408402:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e13631e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97aed expref: 42 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.408418:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de400, rc 0) 00000100:00100000:2.0:1787841949.408522:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+41:10397:x1874687858609024:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 491us (709us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787841949.408539:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 56 00000100:00100000:2.0:1787841949.413645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.413746:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858609280 00000100:00100000:0.0:1787841949.413768:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858609280 00000100:00100000:0.0:1787841949.413832:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:0.0:1787841949.413841:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+41:10397:x1874687858609280:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1787841949.414097:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+42:10397:x1874687858609280:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 256us (462us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787841949.414105:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00000040:00080000:0.0:1787841949.426363:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787841949.500053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841949.500146:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858609536 00000100:00100000:3.0:1787841949.500166:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858609536 00000100:00100000:3.0:1787841949.500222:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:3.0:1787841949.500232:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+42:10404:x1874687858609536:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841949.500256:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841949.500286:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e13632c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97af4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.500409:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.500423:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.500432:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.500491:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.500504:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 43 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841949.500518:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd94b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877515904:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841949.500615:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ce9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841949.504298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.504500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858609664 00000100:00100000:0.0:1787841949.504509:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858609664 00010000:00010000:0.0:1787841949.504550:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 44 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841949.504590:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:0.0:1787841949.504601:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf800f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:2349:x1874687858609664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841949.504614:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841949.504621:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 44 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.504634:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 44 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.504657:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841949.504663:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.504673:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.504688:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.504711:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841949.504785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf800f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:2349:x1874687858609664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 185us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841949.504794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 40 00010000:00010000:3.0:1787841949.505323:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ae6 expref: 43 pid: 5851 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841949.505344:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd94b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877515904:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841949.505375:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.505384:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.505389:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841949.505422:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787841949.505623:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e13632c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.505638:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.505645:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841949.505648:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787841949.505651:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030200, rc 0) 00000100:00100000:3.0:1787841949.505693:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:10404:x1874687858609536:12345-192.168.202.46@tcp:101:bash.0 Request processed in 5462us (5647us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787841949.505700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:1.0:1787841949.509945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841949.510077:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858609920 00000100:00100000:2.0:1787841949.510087:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858609920 00000100:00100000:2.0:1787841949.510161:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 58 00000100:00100000:2.0:1787841949.510171:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf801680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:10404:x1874687858609920:12345-192.168.202.46@tcp:36:bash.0 00010000:00010000:2.0:1787841949.510553:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.510570:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.510583:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841949.510639:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787841949.510664:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3bf5478 reply state 0000000021bccc58 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841949.510673:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841949.510758:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf801680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:10404:x1874687858609920:12345-192.168.202.46@tcp:36:bash.0 Request processed in 587us (821us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787841949.510765:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 58 00000020:00080000:2.0:1787841949.510770:0:8624:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841949.518237:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.518257:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.518275:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.518302:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841949.518307:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.518329:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.518347:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:3.0:1787841949.518351:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841949.518355:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841949.518362:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136341 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841949.526208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.526404:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858610048 00000100:00100000:0.0:1787841949.526416:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858610048 00000100:00100000:0.0:1787841949.526512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:0.0:1787841949.526524:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf802d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:10404:x1874687858610048:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841949.526550:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841949.526573:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97afb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.526685:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.526701:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.526710:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.526746:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.526760:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 46 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841949.526780:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877516032:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841949.526876:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841949.530820:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841949.531013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858610176 00000100:00100000:1.0:1787841949.531034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858610176 00010000:00010000:1.0:1787841949.531079:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 47 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841949.531124:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:1.0:1787841949.531133:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:2348:x1874687858610176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841949.531151:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841949.531158:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 47 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841949.531172:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 47 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841949.531208:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841949.531214:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841949.531224:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841949.531231:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841949.531251:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841949.531327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:2348:x1874687858610176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 194us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841949.531335:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 41 00010000:00010000:0.0:1787841949.532727:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136333 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97af4 expref: 46 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841949.532752:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877516032:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841949.532775:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.532786:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.532791:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841949.532840:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787841949.532845:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841949.532865:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.532910:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97afb expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.532929:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97afb expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.532939:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841949.532957:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841949.532961:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841949.533022:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf802d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:10404:x1874687858610048:12345-192.168.202.46@tcp:101:bash.0 Request processed in 6501us (6839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841949.533031:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:2.0:1787841949.538930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.539008:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858610432 00000100:00100000:0.0:1787841949.539019:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858610432 00000100:00100000:0.0:1787841949.539073:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787841949.539082:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649855d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:10404:x1874687858610432:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:0.0:1787841949.539356:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649855d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:10404:x1874687858610432:12345-192.168.202.46@tcp:35:bash.0 Request processed in 273us (434us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787841949.539363:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:3.0:1787841949.679715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841949.680019:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858610688 00000100:00100000:2.0:1787841949.680031:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858610688 00000100:00100000:2.0:1787841949.680094:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:2.0:1787841949.680120:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:10414:x1874687858610688:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841949.680146:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841949.680167:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b02 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841949.680296:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787841949.680421:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136356 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b02 expref: 48 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.680437:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841949.680441:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841949.680446:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b02 expref: 48 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.680492:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df600, rc 0) 00000100:00100000:2.0:1787841949.680563:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10414:x1874687858610688:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 445us (860us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787841949.680571:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:3.0:1787841949.692573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.693596:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858610816 00000100:00100000:0.0:1787841949.693609:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858610816 00000100:00100000:0.0:1787841949.693745:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:0.0:1787841949.693987:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10414:x1874687858610816:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:0.0:1787841949.694074:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694092:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694105:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694119:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694126:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694228:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694857:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694869:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.694947:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841949.695001:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695014:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695021:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695028:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695033:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841949.695037:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695045:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695056:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:0.0:1787841949.695067:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841949.695073:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695081:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136364 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695099:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695105:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695110:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695115:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841949.695118:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695124:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695132:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648391b700) 00010000:00010000:0.0:1787841949.695134:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841949.695137:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.695143:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13636b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696076:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696094:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696099:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696106:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841949.696110:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696117:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696127:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841949.696130:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841949.696133:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.696138:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841949.696248:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10414:x1874687858610816:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 2491us (3683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841949.696270:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:0.0:1787841949.706641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841949.706795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858611072 00000100:00100000:1.0:1787841949.706808:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858611072 00000100:00100000:1.0:1787841949.706889:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:1.0:1787841949.706899:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10414:x1874687858611072:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841949.707205:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+48:10414:x1874687858611072:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 305us (586us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787841949.707213:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:3.0:1787841949.748040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841949.748117:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858611328 00000100:00100000:2.0:1787841949.748127:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858611328 00000100:00100000:2.0:1787841949.748194:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 62 00000100:00100000:2.0:1787841949.748204:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+48:10417:x1874687858611328:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841949.748231:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841949.748252:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b09 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748370:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748413:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748424:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748442:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748449:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748509:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748967:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13638e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748978:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13638e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.748986:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13638e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841949.748996:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787841949.749091:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749098:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749104:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749117:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dec00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841949.749121:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749129:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749202:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841949.749206:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841949.749212:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749218:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749233:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749239:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749245:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749250:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfe00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841949.749253:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749269:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749289:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946487ed3a00) 00010000:00010000:2.0:1787841949.749291:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841949.749295:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749301:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749569:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b09 expref: 51 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749585:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13638e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b09 expref: 50 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841949.749592:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:2.0:1787841949.749595:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841949.749597:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841949.749684:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10417:x1874687858611328:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1481us (1653us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787841949.749692:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 62 00000100:00100000:3.0:1787841949.754339:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841949.755281:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858611456 00000100:00100000:0.0:1787841949.755295:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858611456 00000100:00100000:0.0:1787841949.755372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:0.0:1787841949.755398:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10417:x1874687858611456:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:0.0:1787841949.755569:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755588:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755600:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755630:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755637:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755643:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755649:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841949.755654:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755661:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755672:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841949.755674:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841949.755679:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841949.755685:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13639c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841949.755788:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10417:x1874687858611456:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 398us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841949.755796:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:0.0:1787841949.757922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841949.758114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858611584 00000100:00100000:1.0:1787841949.758123:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858611584 00000100:00100000:1.0:1787841949.758197:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:1.0:1787841949.758207:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:2349:x1874687858611584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841949.758225:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841949.758248:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e13638e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b09 expref: 50 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841949.758280:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841949.758285:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841949.758350:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:2349:x1874687858611584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 145us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841949.758358:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:2.0:1787841949.767126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841949.767232:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858611840 00000100:00100000:1.0:1787841949.767242:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858611840 00000100:00100000:1.0:1787841949.767319:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:1.0:1787841949.767330:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:10417:x1874687858611840:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841949.767635:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10417:x1874687858611840:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 306us (517us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787841949.767644:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787841950.071966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.072177:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858612096 00000100:00100000:1.0:1787841950.072202:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858612096 00000100:00100000:1.0:1787841950.072274:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:1.0:1787841950.072286:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10434:x1874687858612096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1787841950.072324:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841950.072346:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b10 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.072514:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1363aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.072528:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1363aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.072541:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1363aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841950.072553:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787841950.072693:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b10 expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.072716:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1363aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b10 expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.072726:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:1.0:1787841950.072728:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787841950.072733:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246a00, rc 0) 00000100:00100000:1.0:1787841950.073225:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10434:x1874687858612096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 939us (1267us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787841950.073234:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:0.0:1787841950.149383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.149488:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858612224 00000100:00100000:1.0:1787841950.149499:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858612224 00000100:00100000:1.0:1787841950.149560:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 65 00000100:00100000:1.0:1787841950.149571:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10436:x1874687858612224:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841950.149595:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841950.149621:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b17 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.149692:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1363bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.149706:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1363bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.149718:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1363bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841950.149794:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787841950.149798:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841950.149823:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1363bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.149850:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b17 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.149881:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1363bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b17 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.149891:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841950.149895:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841950.149913:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246600, rc 0) 00000100:00100000:1.0:1787841950.149984:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10436:x1874687858612224:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 415us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.149992:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 65 00000100:00100000:3.0:1787841950.158186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.158505:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858612608 00000100:00100000:1.0:1787841950.158516:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858612608 00000100:00100000:1.0:1787841950.158581:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:1.0:1787841950.158591:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10436:x1874687858612608:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841950.158946:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10436:x1874687858612608:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 355us (771us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787841950.158953:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:2.0:1787841950.161946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.162056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858612736 00000100:00100000:0.0:1787841950.162066:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858612736 00000100:00100000:0.0:1787841950.162140:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787841950.162152:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10436:x1874687858612736:12345-192.168.202.46@tcp:103:lfs.0 00010000:00010000:0.0:1787841950.162169:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787841950.162200:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13634f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97afb expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.162229:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1363aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b10 expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.162242:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13625a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97abc expref: 52 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.162253:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946487ed3100) 00010000:00010000:0.0:1787841950.162276:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841950.162339:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10436:x1874687858612736:12345-192.168.202.46@tcp:103:lfs.0 Request processed in 189us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841950.162347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787841950.165420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.165576:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858612864 00000100:00100000:1.0:1787841950.165587:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858612864 00000100:00100000:1.0:1787841950.165649:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 66 00000100:00100000:1.0:1787841950.165659:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10436:x1874687858612864:12345-192.168.202.46@tcp:58:lfs.0 00010000:00010000:1.0:1787841950.165803:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.165820:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.165832:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841950.166134:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841950.166358:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787841950.166429:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787841950.166586:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10436:x1874687858612864:12345-192.168.202.46@tcp:58:lfs.0 Request processed in 927us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.166605:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 66 00010000:00010000:0.0:1787841950.197184:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841950.198719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.204753:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858612992 00000100:00100000:1.0:1787841950.204769:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858612992 00000100:00100000:1.0:1787841950.204842:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:1.0:1787841950.204851:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10438:x1874687858612992:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841950.204872:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841950.204892:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1363cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b1e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.204960:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.204973:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.204984:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.204998:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205005:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205011:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205109:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205136:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205143:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841950.205181:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787841950.205186:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841950.205203:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205214:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205223:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205228:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205234:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205240:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841950.205243:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205250:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205274:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841950.205277:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841950.205288:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205294:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1363d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205306:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205313:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205318:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205323:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841950.205339:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205346:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205354:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317a200) 00010000:00010000:1.0:1787841950.205356:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841950.205359:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205364:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1363db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205391:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1363cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205414:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.205421:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:1.0:1787841950.205423:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841950.205425:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247e00, rc 0) 00000100:00100000:1.0:1787841950.205950:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10438:x1874687858612992:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1096us (7238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.205959:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 67 00000040:00080000:0.0:1787841950.450737:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841950.450748:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841950.450797:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787841950.450805:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841950.450949:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877516160:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841950.451064:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841950.458162:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ea580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877516160:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841950.460711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.466931:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858613120 00000100:00100000:3.0:1787841950.466947:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858613120 00000100:00100000:3.0:1787841950.467061:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:3.0:1787841950.467073:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613120:12345-192.168.202.46@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787841950.467194:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613120:12345-192.168.202.46@tcp:900:lhsmtool_posix.0 Request processed in 123us (6492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.467221:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:3.0:1787841950.469312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.469425:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858613248 00000100:00100000:0.0:1787841950.469434:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858613248 00000100:00100000:0.0:1787841950.469534:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 68 00000100:00100000:0.0:1787841950.469544:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613248:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841950.469578:0:5849:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787841950.469683:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613248:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 140us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841950.469691:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 68 00000100:00100000:0.0:1787841950.493673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841950.493745:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858613376 00000100:00100000:2.0:1787841950.493755:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858613376 00000100:00100000:2.0:1787841950.493816:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:2.0:1787841950.493828:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613376:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787841950.493901:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.493924:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.493938:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.493955:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.493962:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.493969:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.493996:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494005:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494012:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841950.494049:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787841950.494054:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841950.494073:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494085:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494103:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494110:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494117:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841950.494121:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494130:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494156:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:2.0:1787841950.494160:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841950.494166:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494172:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1363e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494187:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494193:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494198:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494203:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841950.494215:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494221:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494229:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff946487ed3a00) 00010000:00010000:2.0:1787841950.494232:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841950.494234:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494241:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1363f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494267:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494273:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494279:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494285:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841950.494288:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494293:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494300:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:2.0:1787841950.494302:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841950.494311:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.494317:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1363f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841950.494391:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613376:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 Request processed in 565us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841950.494399:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:1.0:1787841950.501664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.501736:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858613632 00000100:00100000:0.0:1787841950.501746:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858613632 00000100:00100000:0.0:1787841950.501806:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00100000:0.0:1787841950.501817:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10449:x1874687858613632:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841950.501841:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841950.501863:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1363fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.501976:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.501994:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502016:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841950.502029:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787841950.502152:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502160:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502168:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502174:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841950.502179:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502187:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502202:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:0.0:1787841950.502205:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841950.502210:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502217:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502274:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1363fe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b25 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502296:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:0.0:1787841950.502298:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841950.502302:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e1363fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b25 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.502313:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480400, rc 0) 00000100:00100000:0.0:1787841950.502414:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10449:x1874687858613632:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 598us (759us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787841950.502421:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00100000:3.0:1787841950.509515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.509581:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858613760 00000100:00100000:0.0:1787841950.509592:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858613760 00000100:00100000:0.0:1787841950.509658:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00100000:0.0:1787841950.509669:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10449:x1874687858613760:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841950.509709:0:5850:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787841950.509828:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10449:x1874687858613760:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 160us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841950.509835:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00100000:1.0:1787841950.515374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.515676:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858614016 00000100:00100000:3.0:1787841950.515686:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858614016 00000100:00100000:3.0:1787841950.515750:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:3.0:1787841950.515770:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf801e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10449:x1874687858614016:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841950.515793:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841950.515797:0:8624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841950.515827:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1363bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b17 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.515845:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:3.0:1787841950.515852:0:8624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841950.515865:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136413 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b2c expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841950.518948:0:8624:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787841950.519247:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13641a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.519278:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.519294:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.523633:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b2c expref: 55 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.523663:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13641a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b2c expref: 54 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.523672:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9464999d2800) 00010000:00010000:2.0:1787841950.523676:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841950.523679:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:2.0:1787841950.523744:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf801e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10449:x1874687858614016:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 7976us (8381us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787841950.523753:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:3.0:1787841950.528130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.528267:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858614272 00000100:00100000:0.0:1787841950.528279:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858614272 00000100:00100000:0.0:1787841950.528344:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 73 00000100:00100000:0.0:1787841950.528354:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10449:x1874687858614272:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841950.528416:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841950.528444:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13641a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b2c expref: 54 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528687:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9464999d2800) 00010000:00010000:0.0:1787841950.528698:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841950.528723:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528737:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528747:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528762:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528770:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528776:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528847:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528854:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528861:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528867:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841950.528871:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528885:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528893:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:0.0:1787841950.528896:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841950.528899:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528905:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136428 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528918:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528924:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528930:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528935:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841950.528938:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528944:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528951:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb9490bf6 (ffff94648391b700) 00010000:00010000:0.0:1787841950.528953:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841950.528956:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.528972:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13642f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb9490bf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841950.529056:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10449:x1874687858614272:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 704us (936us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841950.529064:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 73 00000100:00100000:3.0:1787841950.544086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.544304:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858614400 00000100:00100000:0.0:1787841950.544316:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858614400 00000100:00100000:0.0:1787841950.544417:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 74 00000100:00100000:0.0:1787841950.544428:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10449:x1874687858614400:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841950.544450:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841950.544520:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136436 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b33 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.544560:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.544575:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.544587:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.544696:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.544717:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.544740:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841950.544744:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841950.544747:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480400, rc 0) 00000100:00100000:0.0:1787841950.544816:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10449:x1874687858614400:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 389us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841950.544823:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 74 00000100:00100000:1.0:1787841950.557843:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.557945:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858614656 00000100:00100000:0.0:1787841950.557955:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858614656 00000100:00100000:0.0:1787841950.558015:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 75 00000100:00100000:0.0:1787841950.558027:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf800b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10449:x1874687858614656:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841950.558115:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.558133:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.558228:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841950.559370:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787841950.559383:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339533925647ns, next at 340533923059ns, rc = 0 00000004:00010000:0.0:1787841950.559560:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c167bd9f reply state 00000000d35786b3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841950.559572:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841950.559676:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf800b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10449:x1874687858614656:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 1650us (1843us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787841950.559701:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 75 00000100:00100000:3.0:1787841950.562989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1787841950.563035:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.563047:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.563054:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.563060:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841950.563064:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.563072:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.563088:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:3.0:1787841950.563091:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841950.563095:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.563101:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136444 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841950.564549:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858614784 00000100:00100000:1.0:1787841950.564564:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858614784 00000100:00100000:1.0:1787841950.564637:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:1.0:1787841950.564648:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10449:x1874687858614784:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841950.564676:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841950.564699:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b3a expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.564763:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 56 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.564778:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 56 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.564816:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:1.0:1787841950.564820:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841950.564824:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246400, rc 0) 00000100:00100000:1.0:1787841950.564891:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10449:x1874687858614784:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 245us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.564899:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:1.0:1787841950.568394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.568588:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858614912 00000100:00100000:3.0:1787841950.568599:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858614912 00000100:00100000:3.0:1787841950.568649:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:3.0:1787841950.568657:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874687858614912:12345-192.168.202.46@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787841950.568692:0:6691:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787841950.568737:0:6691:0:(genops.c:1385:class_connect()) connect: client 7142e368-78a3-4f67-bb12-5e4ed629eb65, cookie 0x1d0ed3605e136452 00002000:00100000:3.0:1787841950.568750:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7142e368-78a3-4f67-bb12-5e4ed629eb65/ffff9464badbf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787841950.568775:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787841950.569032:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787841950.569067:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9464bfa17800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841950.569141:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2345:x1874687858614912:12345-192.168.202.46@tcp:8:lhsmtool_posix.0 Request processed in 483us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.569149:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:1.0:1787841950.573494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841950.573584:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858615040 00000100:00100000:2.0:1787841950.573594:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858615040 00000100:00100000:2.0:1787841950.573676:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:2.0:1787841950.573686:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:0:x1874687858615040:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787841950.574005:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787841950.620104:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787841950.620122:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000100:00100000:3.0:1787841950.620494:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:0:x1874687858615040:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 46770us (47007us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787841950.620506:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:2.0:1787841950.623816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.624021:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858615296 00000100:00100000:1.0:1787841950.624031:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858615296 00000100:00100000:1.0:1787841950.624085:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787841950.624094:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10449:x1874687858615296:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787841950.624414:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10449:x1874687858615296:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 319us (605us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787841950.624422:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787841950.627078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.627162:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858615552 00000100:00100000:3.0:1787841950.627171:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858615552 00000100:00100000:3.0:1787841950.627227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:3.0:1787841950.627236:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf803840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10449:x1874687858615552:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787841950.627351:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf803840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10449:x1874687858615552:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.627359:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:3.0:1787841950.629928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.630059:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858615680 00000100:00100000:1.0:1787841950.630069:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858615680 00000100:00100000:1.0:1787841950.630121:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 78 00000100:00100000:1.0:1787841950.630130:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10449:x1874687858615680:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841950.630159:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841950.630182:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b41 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.630302:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.630317:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.630329:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841950.630365:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841950.630382:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.630410:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b41 expref: 59 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.630429:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b41 expref: 58 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.630438:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:1.0:1787841950.630440:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787841950.630443:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247a00, rc 0) 00000100:00100000:1.0:1787841950.630549:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:10449:x1874687858615680:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 419us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.630556:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 78 00000100:00100000:2.0:1787841950.642166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.645025:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858615808 00000100:00100000:3.0:1787841950.645041:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858615808 00000100:00100000:3.0:1787841950.645116:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:3.0:1787841950.645126:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858615808:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841950.645159:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841950.645186:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b48 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841950.645230:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904d9f, blocks: 0x1 00010000:00010000:3.0:1787841950.645260:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1787841950.645266:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841950.645276:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.645301:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.645315:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498c00, rc 0) 00000100:00100000:3.0:1787841950.645395:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858615808:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 271us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.645404:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:2.0:1787841950.650105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.650271:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616064 00000100:00100000:0.0:1787841950.650282:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616064 00000100:00100000:0.0:1787841950.650348:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00100000:0.0:1787841950.650358:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:10449:x1874687858616064:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787841950.650497:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:10449:x1874687858616064:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 140us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841950.650505:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00100000:2.0:1787841950.657345:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.659354:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616192 00000100:00100000:0.0:1787841950.659378:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616192 00000100:00100000:0.0:1787841950.659449:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:0.0:1787841950.659654:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:10449:x1874687858616192:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841950.659678:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841950.659703:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b4f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.659738:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.659748:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841950.659753:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841950.659759:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.659813:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.659829:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 7 pid: 6691 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841950.659846:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7dded00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1874687877516288:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841950.660083:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464932e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841950.663245:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.663394:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616320 00000100:00100000:1.0:1787841950.663403:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616320 00010000:00010000:1.0:1787841950.663445:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 8 pid: 6691 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841950.663525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:1.0:1787841950.663534:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858616320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841950.663552:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841950.663578:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 8 pid: 6691 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.663594:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 8 pid: 6691 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.663624:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841950.663629:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841950.663638:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.663649:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.663688:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841950.663714:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf801a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874687877516416:192.168.202.46@tcp:105: 00000100:00100000:1.0:1787841950.663805:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787841950.663904:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000910e597/0x1d0ed3605e136467 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b48 expref: 8 pid: 6691 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841950.663922:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7dded00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1874687877516288:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841950.663950:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.663962:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480a00, rc 0) 00000100:00100000:3.0:1787841950.663993:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:10449:x1874687858616192:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 4535us (6658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.664013:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:3.0:1787841950.667273:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf801a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874687877516416:192.168.202.46@tcp:105: 00010000:00010000:3.0:1787841950.667299:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841950.667400:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858616320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3865us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.667411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:0.0:1787841950.670021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.671049:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616448 00000100:00100000:1.0:1787841950.671064:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616448 00002000:00100000:1.0:1787841950.671136:0:6699:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9464b7ddc000 x1874687858616448/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:451/0 lens 504/0 e 0 to 0 dl 1787841961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787841950.671149:0:6699:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b7ddc000 with x1874687858616448 ext(0->8) 00002000:00010000:1.0:1787841950.671154:0:6699:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464b7ddc000 00000100:00100000:1.0:1787841950.671183:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:1.0:1787841950.671193:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858616448:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787841950.671900:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858616448:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 Request processed in 705us (1887us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787841950.671909:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00002000:00100000:1.0:1787841950.671918:0:6699:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9464b7ddc000 x1874687858616448/t4294967302(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:451/0 lens 504/448 e 0 to 0 dl 1787841961 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787841950.671926:0:6699:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b7ddc000 with x1874687858616448 ext(0->8) 00002000:00010000:1.0:1787841950.671931:0:6699:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464b7ddc000 00000100:00100000:1.0:1787841950.675057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.675239:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616576 00000100:00100000:3.0:1787841950.675258:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616576 00000100:00100000:3.0:1787841950.675349:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:3.0:1787841950.675359:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf800780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:10449:x1874687858616576:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787841950.779207:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787841950.779220:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787841950.779240:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787841950.779271:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9464871e4180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787841950.779276:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946488825500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9464871e46c0 00000020:00080000:1.0:1787841950.779280:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946488825300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464b7e91000 00000001:00080000:1.0:1787841950.779294:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787841950.779657:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787841950.779772:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787841950.779794:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf803c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877516544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787841950.779895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841950.779976:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877516544 00000100:00100000:1.0:1787841950.779983:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877516544 00000100:00100000:1.0:1787841950.780032:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787841950.780039:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877516544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787841950.780162:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787841950.780166:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787841951 00002000:00010000:1.0:1787841950.780169:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787841950.780171:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787841951 -> 1787841951 00002000:00010000:1.0:1787841950.780173:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787841950.780210:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877516544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (316us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787841950.780217:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787841950.780236:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787841950.780274:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464bf803c00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787841950.780279:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf803c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877516544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787841950.781298:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf800780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10449:x1874687858616576:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 Request processed in 105935us (106244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.781310:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:3.0:1787841950.781631:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841950.781645:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877516672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787841950.781689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841950.781733:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877516672 00000100:00100000:3.0:1787841950.781739:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877516672 00000100:00100000:3.0:1787841950.781782:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787841950.781791:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877516672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787841950.781813:0:6693:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787841950.781842:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a904d9c, atime: 0x6a904d9c, ctime: 0x6a904d9c, blocks: 0xb 00010000:00010000:3.0:1787841950.781850:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.781892:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1787841950.781896:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841950.781902:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.781917:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.781928:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.781936:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.781952:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787841950.784185:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1874687877516672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2388us (2488us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787841950.784198:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787841950.784240:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841950.784261:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.784274:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841950.784279:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.784308:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841950.785547:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787841950.785695:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.785711:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000910e597/0x1d0ed3605e136475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.785738:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841950.785741:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841950.785743:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787841950.785789:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464bf80e580/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787841950.785799:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877516672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787841950.800487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.802604:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616704 00000100:00100000:0.0:1787841950.802619:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616704 00000100:00100000:0.0:1787841950.802716:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 30 00000100:00100000:0.0:1787841950.802727:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf802580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858616704:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787841950.880948:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf802580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858616704:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 Request processed in 78210us (80485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841950.881325:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 30 00000001:00080000:2.0:1787841950.881721:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787841950.881735:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787841950.890657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.891192:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858616960 00000100:00100000:0.0:1787841950.891203:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858616960 00000100:00100000:0.0:1787841950.891268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:0.0:1787841950.891278:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10449:x1874687858616960:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841950.891332:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841950.891370:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b41 expref: 13 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.891412:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841950.891418:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841950.891448:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.891481:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841950.891492:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841950.891739:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f32ba44 reply state 0000000029dfa8b9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841950.891749:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841950.892115:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:10449:x1874687858616960:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 837us (1469us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787841950.892123:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:2.0:1787841950.903441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841950.905430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858617088 00000100:00100000:0.0:1787841950.905444:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858617088 00000100:00100000:0.0:1787841950.905522:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:0.0:1787841950.905531:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858617088:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787841950.905821:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787841950.905825:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787841951 -> 1787841950 00002000:00010000:0.0:1787841950.905827:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787841948 00002000:00010000:0.0:1787841950.905830:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787841951 -> 1787841950 00002000:00010000:0.0:1787841950.905832:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787841950.905915:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858617088:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 384us (2483us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787841950.905923:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 31 00010000:00010000:2.0:1787841950.906645:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.906669:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.906677:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.906684:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841950.906689:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.906698:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.906716:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:2.0:1787841950.906720:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841950.906726:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841950.906733:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13647c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841950.935585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841950.935682:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858617344 00000100:00100000:3.0:1787841950.935693:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858617344 00000100:00100000:3.0:1787841950.935759:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00100000:3.0:1787841950.935770:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10449:x1874687858617344:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787841950.935838:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.935856:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.935880:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.935928:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.935943:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 13 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841950.935956:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877516800:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841950.936039:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841950.939980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.940148:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877516800:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841950.940180:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841950.946986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858617472 00000100:00100000:3.0:1787841950.947002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858617472 00010000:00010000:3.0:1787841950.947054:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841950.947157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:3.0:1787841950.947169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2349:x1874687858617472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841950.947184:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841950.947191:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.947205:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.947228:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13643d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b33 expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.947244:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:3.0:1787841950.947267:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.947276:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.947283:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841950.947317:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841950.947391:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2349:x1874687858617472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 224us (7421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841950.947399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00010000:00010000:1.0:1787841950.947626:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947635:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947679:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947686:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947692:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947698:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841950.947703:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947709:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947717:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:1.0:1787841950.947720:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787841950.947723:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.947729:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841950.947778:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:10449:x1874687858617344:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 Request processed in 12009us (12203us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787841950.947786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00100000:3.0:1787841950.958561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841950.958649:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858617600 00000100:00100000:1.0:1787841950.958660:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858617600 00000100:00100000:1.0:1787841950.958724:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:1.0:1787841950.958742:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858617600:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787841950.958801:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.958824:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.958833:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841950.958838:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841950.958842:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.958879:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841950.958894:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 7 pid: 6693 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841950.958908:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf8030c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877516928:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841950.972490:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841950.975516:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf8003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877517440:0@lo:400:kworker.0 00000100:00100000:1.0:1787841950.975590:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841950.975620:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877517440 00000100:00100000:2.0:1787841950.975629:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877517440 00000100:00100000:1.0:1787841950.975632:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841950.975637:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf802940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877517056:0@lo:400:kworker.0 00000100:00100000:1.0:1787841950.975664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841950.975688:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf8021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877517184:0@lo:400:kworker.0 00000100:00100000:2.0:1787841950.975696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787841950.975705:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf802580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877517440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841950.975720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841950.975738:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841950.975743:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877517312:0@lo:400:kworker.0 00000100:00100000:1.0:1787841950.975763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841950.975794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877517056 00000100:00100000:1.0:1787841950.975797:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877517056 00000100:00100000:1.0:1787841950.975828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787841950.975834:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877517056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841950.975964:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf802580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877517440:12345-0@lo:400:kworker.0 Request processed in 260us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841950.975972:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787841950.975989:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877517184 00000100:00100000:2.0:1787841950.975993:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877517184 00000100:00100000:2.0:1787841950.976006:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877517312 00000100:00100000:2.0:1787841950.976008:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877517312 00000100:00100000:1.0:1787841950.976013:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877517056:12345-0@lo:400:kworker.0 Request processed in 179us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.976020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787841950.976022:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787841950.976026:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf800f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877517184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841950.976053:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787841950.976059:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf800f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877517184:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.976060:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf801a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877517312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841950.976066:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1787841950.976082:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841950.976088:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf801a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877517312:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841950.976093:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787841950.976114:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877517312:0@lo:400:kworker.0 00000100:00100000:2.0:1787841950.976424:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf8021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877517184:0@lo:400:kworker.0 00000100:00100000:2.0:1787841950.976485:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf802940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877517056:0@lo:400:kworker.0 00000100:00100000:2.0:1787841950.976497:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf8003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877517440:0@lo:400:kworker.0 00000100:00100000:2.0:1787841951.011727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841951.011808:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf8030c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877516928:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841951.011841:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.012401:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858617728 00000100:00100000:3.0:1787841951.012410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858617728 00010000:00010000:3.0:1787841951.012486:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.012536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:3.0:1787841951.012547:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858617728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841951.012568:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841951.012598:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.012611:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.012635:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13646e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b4f expref: 8 pid: 6693 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.012670:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841951.012674:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841951.012680:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.012690:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.012718:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841951.012787:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858617728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 239us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841951.012795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 44 00010000:00010000:0.0:1787841951.013880:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.013898:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.013931:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.013940:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.013948:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.013956:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841951.013960:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.013989:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.014009:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.014018:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e13648a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841951.014106:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858617600:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 Request processed in 55364us (55550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841951.014115:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:2.0:1787841951.022710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841951.025514:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858617984 00000100:00100000:0.0:1787841951.025530:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858617984 00000100:00100000:0.0:1787841951.025632:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 83 00000100:00100000:0.0:1787841951.025643:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:10449:x1874687858617984:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00080000:2.0:1787841951.025714:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841951.025740:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.025758:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.025772:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.025988:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.026012:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 13 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.026022:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.026054:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 13 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.026067:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 13 pid: 8624 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841951.026081:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ddcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877517568:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841951.026177:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff946486013cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841951.028646:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ddcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877517568:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841951.028673:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841951.034522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841951.035772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858618112 00000100:00100000:3.0:1787841951.035786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858618112 00010000:00010000:3.0:1787841951.035848:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 14 pid: 8624 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.035919:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:3.0:1787841951.035929:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2349:x1874687858618112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841951.035950:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841951.035957:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 14 pid: 8624 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.035979:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 14 pid: 8624 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.036005:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e13644b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b3a expref: 14 pid: 8624 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.036022:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:3.0:1787841951.036029:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.036038:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.036047:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.036074:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841951.036131:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2349:x1874687858618112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 203us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841951.036140:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 45 00010000:00010000:3.0:1787841951.036170:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.036177:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841951.036480:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787841951.041827:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787841951.042052:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787841951.042189:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874687877517696:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787841951.042267:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841951.042300:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7ddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841951.043664:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877517696 00000100:00100000:2.0:1787841951.043681:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877517696 00000100:00100000:2.0:1787841951.043772:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841951.043784:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874687877517696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787841951.043925:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874687877517696:12345-0@lo:1000:mdt00_001.0 Request processed in 143us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841951.043933:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841951.047177:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787841951.047198:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464bf803c00, transno 4294967303 00000100:00100000:3.0:1787841951.047225:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874687877517696:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787841951.047770:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787841951.047853:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874687877517824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787841951.047927:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841951.047961:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841951.049358:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877517824 00000100:00100000:2.0:1787841951.049370:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877517824 00000100:00100000:2.0:1787841951.049431:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787841951.049441:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874687877517824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787841951.049720:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874687877517824:12345-0@lo:1000:mdt00_001.0 Request processed in 279us (1792us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787841951.049728:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841951.049800:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874687877517824:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787841951.049853:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.049876:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.049884:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.049891:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841951.049896:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.049922:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.049939:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841951.049943:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841951.049949:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.049956:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136498 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050002:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050008:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050014:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050018:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841951.050021:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050027:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050035:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:0.0:1787841951.050037:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841951.050040:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050055:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1363c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050077:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050092:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050101:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050133:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.050146:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 16 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841951.050159:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7dde1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877517952:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841951.050956:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464860136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841951.061122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841951.061623:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7dde1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877517952:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841951.061665:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.062080:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858618240 00000100:00100000:3.0:1787841951.062087:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858618240 00010000:00010000:3.0:1787841951.062126:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 17 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.062185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:3.0:1787841951.062196:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:2348:x1874687858618240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841951.062211:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841951.062220:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 17 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.062233:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 17 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.062266:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1363e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b1e expref: 17 pid: 5851 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.062314:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:3.0:1787841951.062322:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.062332:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.062340:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.062375:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841951.062443:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:2348:x1874687858618240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 244us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841951.062483:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 46 00010000:00010000:0.0:1787841951.062641:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062654:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062678:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062684:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062690:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062696:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841951.062700:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062707:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062716:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:0.0:1787841951.062719:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841951.062723:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062729:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e13649f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062757:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062763:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062769:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062781:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841951.062784:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062790:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062798:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94649317ac00) 00010000:00010000:0.0:1787841951.062800:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841951.062803:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.062808:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841951.063094:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:10449:x1874687858617984:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 37449us (40391us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787841951.063111:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 83 00000020:00080000:0.0:1787841951.063118:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787841951.063395:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841951.063400:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841951.063428:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787841951.063440:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787841951.066218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841951.069178:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858618496 00000100:00100000:3.0:1787841951.069207:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858618496 00000100:00100000:3.0:1787841951.069287:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:3.0:1787841951.069298:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:10449:x1874687858618496:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787841951.070009:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787841951.070123:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787841951.070172:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.070189:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.070209:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.070218:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.070224:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.070230:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.070265:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787841951.070364:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:10449:x1874687858618496:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 1066us (4152us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787841951.070374:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00000020:00080000:3.0:1787841951.070379:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787841951.070736:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841951.070744:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.070752:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787841951.070756:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.070765:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.070778:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9464999d2300) 00010000:00010000:1.0:1787841951.070789:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787841951.070795:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.070802:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.070820:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841951.070822:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841951.070823:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841951.220851:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841951.503987:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841951.504013:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7dde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877518080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841951.504088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841951.504157:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877518080 00000100:00100000:0.0:1787841951.504164:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877518080 00000100:00100000:0.0:1787841951.504211:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787841951.504220:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874687877518080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841951.504268:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841951.504336:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874687877518080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841951.504345:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787841951.504401:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7dde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877518080:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787841951.570916:0:11997:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841951.570927:0:11997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841951.570977:0:11997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787841951.570984:0:11997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841951.784562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841951.784655:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858618752 00000100:00100000:1.0:1787841951.784665:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858618752 00000100:00100000:1.0:1787841951.784728:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:1.0:1787841951.784739:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:10459:x1874687858618752:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841951.784778:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841951.784799:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1364ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b56 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.785073:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1364b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.785089:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1364b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.785100:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1364b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841951.785111:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787841951.785288:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1364ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b56 expref: 20 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.785328:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1364b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b56 expref: 19 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.785338:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841951.785341:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841951.785344:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247e00, rc 0) 00000100:00100000:1.0:1787841951.785412:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10459:x1874687858618752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 674us (862us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787841951.785420:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:0.0:1787841951.804435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841951.804885:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858618880 00000100:00100000:3.0:1787841951.804896:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858618880 00000100:00100000:3.0:1787841951.804950:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:3.0:1787841951.804961:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10459:x1874687858618880:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:3.0:1787841951.805043:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805062:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805075:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805103:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805112:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805119:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805433:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805443:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805451:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841951.805630:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805644:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805651:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805659:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805665:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841951.805670:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805683:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805697:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:3.0:1787841951.805700:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841951.805705:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805712:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1364c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805724:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805730:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805736:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805742:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841951.805745:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805750:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805757:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9464999d2400) 00010000:00010000:3.0:1787841951.805759:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841951.805761:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1364c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805790:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805797:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805803:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805809:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841951.805812:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805818:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805825:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9464999d2300) 00010000:00010000:3.0:1787841951.805827:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841951.805830:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.805837:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1364d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.805920:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10459:x1874687858618880:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 958us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841951.805928:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:0.0:1787841951.886426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841951.886487:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858619136 00000100:00100000:0.0:1787841951.886499:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858619136 00000100:00100000:0.0:1787841951.886556:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:0.0:1787841951.886567:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10462:x1874687858619136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841951.886588:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841951.886610:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1364d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b5d expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.886686:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.886703:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.886716:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.886731:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.886738:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.886764:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887105:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887115:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887123:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841951.887133:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787841951.887223:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887231:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887251:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887258:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841951.887262:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887269:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887283:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:0.0:1787841951.887286:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841951.887298:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887304:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1364de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887322:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887329:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887335:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887341:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841951.887343:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887348:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887356:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648391b700) 00010000:00010000:0.0:1787841951.887358:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841951.887361:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887366:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1364e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887407:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e1364d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 22 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887437:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 21 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841951.887445:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:0.0:1787841951.887447:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841951.887450:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480a00, rc 0) 00000100:00100000:0.0:1787841951.887542:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10462:x1874687858619136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 976us (1126us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787841951.887550:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:0.0:1787841951.896215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841951.896363:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858619264 00000100:00100000:3.0:1787841951.896375:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858619264 00000100:00100000:3.0:1787841951.896431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00100000:3.0:1787841951.896441:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10462:x1874687858619264:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:3.0:1787841951.896541:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896558:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896569:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896593:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896598:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896604:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896610:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841951.896614:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896620:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896631:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:3.0:1787841951.896633:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841951.896638:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841951.896656:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1364fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841951.896725:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10462:x1874687858619264:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 285us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841951.896731:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00100000:0.0:1787841951.908110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841951.908198:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858619520 00000100:00100000:1.0:1787841951.908208:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858619520 00000100:00100000:1.0:1787841951.908277:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:1.0:1787841951.908294:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649855f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10462:x1874687858619520:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841951.908555:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649855f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:10462:x1874687858619520:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 269us (455us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787841951.908564:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:2.0:1787841951.977511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841951.981526:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858619776 00000100:00100000:1.0:1787841951.981540:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858619776 00000100:00100000:1.0:1787841951.981607:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 88 00000100:00100000:1.0:1787841951.981618:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:9990:x1874687858619776:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841951.981642:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841951.981663:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e136501 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b64 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.981767:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.981790:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 23 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.981799:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.981835:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 23 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841951.981849:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 23 pid: 8624 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841951.981863:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877518208:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841951.981965:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841951.988221:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841951.988257:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877518336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841951.988447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841951.988956:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877518336 00000100:00100000:0.0:1787841951.988965:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877518336 00000100:00100000:0.0:1787841951.989014:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841951.989025:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648662dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877518336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841951.989049:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787841951.989101:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648662dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877518336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841951.989108:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787841951.991567:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877518336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841952.014604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.014644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858619904 00000100:00100000:1.0:1787841952.014652:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858619904 00010000:00010000:1.0:1787841952.014697:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 24 pid: 8624 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841952.014731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:1.0:1787841952.014741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:2349:x1874687858619904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841952.014756:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841952.014763:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 24 pid: 8624 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.014791:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 24 pid: 8624 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.014814:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:1.0:1787841952.014820:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.014829:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.014837:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.014857:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841952.014910:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:2349:x1874687858619904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 170us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841952.014918:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00010000:00010000:1.0:1787841952.015047:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1364ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b5d expref: 23 pid: 8624 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841952.015067:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877518208:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841952.015089:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.015097:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.015103:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841952.015129:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787841952.015281:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e136501 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 24 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.015307:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 23 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.015316:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:1.0:1787841952.015319:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841952.015322:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247800, rc 0) 00000100:00100000:1.0:1787841952.015357:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:9990:x1874687858619776:12345-192.168.202.46@tcp:101:bash.0 Request processed in 33741us (37857us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787841952.015365:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 88 00000100:00100000:2.0:1787841952.021950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.022015:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858620160 00000100:00100000:3.0:1787841952.022026:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858620160 00000100:00100000:3.0:1787841952.022114:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 89 00000100:00100000:3.0:1787841952.022125:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:9990:x1874687858620160:12345-192.168.202.46@tcp:36:bash.0 00010000:00010000:3.0:1787841952.023027:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.023047:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.023060:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841952.023118:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787841952.023145:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000104161b4 reply state 00000000a8630cb8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.023154:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787841952.023207:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787841952.025016:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:9990:x1874687858620160:12345-192.168.202.46@tcp:36:bash.0 Request processed in 2881us (3063us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787841952.025029:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 89 00000020:00080000:3.0:1787841952.025036:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787841952.033818:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.033836:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.033843:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.033849:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841952.033854:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.033862:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.034026:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:3.0:1787841952.034031:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841952.034038:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.034045:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136516 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.034399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.034746:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858620288 00000100:00100000:1.0:1787841952.034915:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858620288 00000100:00100000:1.0:1787841952.034982:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 90 00000100:00100000:1.0:1787841952.034993:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:9990:x1874687858620288:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841952.035017:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841952.035036:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e13651d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b6b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.035097:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e13651d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b6b expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.035112:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e13651d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b6b expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.035148:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:1.0:1787841952.035152:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841952.035156:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246c00, rc 0) 00000100:00100000:1.0:1787841952.036762:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:9990:x1874687858620288:12345-192.168.202.46@tcp:101:bash.0 Request processed in 1762us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841952.036774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 90 00000100:00100000:2.0:1787841952.071649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.071742:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858620416 00000100:00100000:3.0:1787841952.071752:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858620416 00000100:00100000:3.0:1787841952.071831:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:3.0:1787841952.071843:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:9990:x1874687858620416:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841952.071863:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841952.071884:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b72 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841952.071931:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a904d9e, atime: 0x6a904d9c, ctime: 0x6a904d9e, blocks: 0xb 00010000:00010000:3.0:1787841952.071956:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1787841952.071961:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841952.071968:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.071986:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.071999:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499800, rc 0) 00000100:00100000:3.0:1787841952.072053:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:9990:x1874687858620416:12345-192.168.202.46@tcp:101:bash.0 Request processed in 213us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.072060:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00080000:2.0:1787841952.072487:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841952.073888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.073943:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858620544 00000100:00100000:2.0:1787841952.073951:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858620544 00002000:00010000:2.0:1787841952.073995:0:6697:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787841952.074012:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b7ddf480 with x1874687858620544 ext(0->18446744073709551615) 00002000:00010000:2.0:1787841952.074023:0:6697:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464b7ddf480. 00000100:00100000:2.0:1787841952.074056:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787841952.074066:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858620544:12345-192.168.202.46@tcp:10:bash.0 00002000:00010000:2.0:1787841952.074561:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787841952.074565:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787841950 -> 1787841952 00002000:00010000:2.0:1787841952.074568:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787841948 -> 1787841948 00002000:00010000:2.0:1787841952.074571:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787841950 -> 1787841952 00002000:00010000:2.0:1787841952.074573:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787841952.074618:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858620544:12345-192.168.202.46@tcp:10:bash.0 Request processed in 554us (737us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787841952.074626:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00002000:00010000:2.0:1787841952.074629:0:6697:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787841952.074632:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b7ddf480 with x1874687858620544 ext(0->18446744073709551615) 00002000:00010000:2.0:1787841952.074637:0:6697:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464b7ddf480. 00000100:00100000:0.0:1787841952.211163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.212093:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858620672 00000100:00100000:2.0:1787841952.212106:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858620672 00000100:00100000:2.0:1787841952.212185:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 91 00000100:00100000:2.0:1787841952.212195:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:10476:x1874687858620672:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:2.0:1787841952.212276:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212304:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212316:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212347:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212362:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212369:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212676:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212686:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212693:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841952.212733:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212744:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212750:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212756:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212763:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.212767:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212781:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212794:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841952.212973:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.212979:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212986:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13652b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.212999:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213004:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213009:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213014:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.213017:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213023:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213031:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946487ed3a00) 00010000:00010000:2.0:1787841952.213033:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.213035:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213050:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213067:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213072:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213078:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213083:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.213086:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213092:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213099:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:2.0:1787841952.213101:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.213104:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.213109:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.214098:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:10476:x1874687858620672:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 1897us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841952.214109:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 91 00010000:00010000:0.0:1787841952.242488:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841952.311713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.311824:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858620928 00000100:00100000:2.0:1787841952.311836:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858620928 00000100:00100000:2.0:1787841952.311902:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:2.0:1787841952.312033:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:10479:x1874687858620928:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841952.312057:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841952.312078:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b79 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312149:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312166:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312189:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312204:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312211:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312217:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312824:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312835:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.312854:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841952.312866:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787841952.313037:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313045:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313052:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313058:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.313063:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313071:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313083:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841952.313086:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.313090:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313096:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313108:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313113:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313125:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313130:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.313133:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313139:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313147:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946487ed3a00) 00010000:00010000:2.0:1787841952.313149:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.313153:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313159:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e13654e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313315:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b79 expref: 30 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313331:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b79 expref: 29 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.313339:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:2.0:1787841952.313341:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787841952.313343:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841952.313428:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10479:x1874687858620928:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1400us (1724us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787841952.313445:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:1.0:1787841952.322083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.325719:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858621056 00000100:00100000:2.0:1787841952.325734:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858621056 00000100:00100000:2.0:1787841952.325817:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 93 00000100:00100000:2.0:1787841952.325828:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf803c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10479:x1874687858621056:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:2.0:1787841952.325893:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.325921:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 29 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.325930:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.325964:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 29 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.325978:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 29 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.325992:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877518464:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841952.326107:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841952.332507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.332589:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858621312 00000100:00100000:1.0:1787841952.332599:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858621312 00000100:00100000:1.0:1787841952.332674:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:1.0:1787841952.332685:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+30:5587:x1874687858621312:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787841952.333026:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:5587:x1874687858621312:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 341us (527us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787841952.333034:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:2.0:1787841952.335032:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877518464:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841952.335064:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841952.341938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.342900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858621440 00000100:00100000:1.0:1787841952.342914:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858621440 00010000:00010000:1.0:1787841952.342962:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 31 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841952.343016:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:1.0:1787841952.343027:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dde580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:2349:x1874687858621440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841952.343042:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841952.343049:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 31 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.343085:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 31 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.343112:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136508 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b64 expref: 31 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.343130:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:1.0:1787841952.343136:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.343147:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.343157:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.343193:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841952.343279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dde580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+30:2349:x1874687858621440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 254us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841952.343288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 48 00010000:00010000:0.0:1787841952.343554:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343575:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343606:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343613:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343620:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343625:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841952.343629:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343636:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343645:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:0.0:1787841952.343648:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841952.343653:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841952.343659:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841952.343701:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf803c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10479:x1874687858621056:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 17874us (21628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841952.343708:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 93 00000100:00100000:1.0:1787841952.346392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.346525:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858621696 00000100:00100000:3.0:1787841952.346535:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858621696 00000100:00100000:3.0:1787841952.346589:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:3.0:1787841952.346599:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:10479:x1874687858621696:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841952.346836:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+30:10479:x1874687858621696:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 238us (453us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787841952.346844:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:3.0:1787841952.479077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.479211:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858621952 00000100:00100000:1.0:1787841952.479220:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858621952 00000100:00100000:1.0:1787841952.479406:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 94 00000100:00100000:1.0:1787841952.479422:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+30:10490:x1874687858621952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1787841952.479446:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841952.479503:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e13656a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b80 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479591:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479603:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479613:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479639:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479647:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479654:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.479991:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13657f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480001:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13657f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480008:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13657f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841952.480018:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787841952.480108:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480113:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480122:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480126:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841952.480129:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480134:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480143:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841952.480146:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841952.480149:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480153:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136571 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480161:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480164:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480168:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480171:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841952.480173:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480182:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480187:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317a200) 00010000:00010000:1.0:1787841952.480188:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841952.480190:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480193:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e136578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480225:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e13656a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b80 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480246:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13657f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b80 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.480250:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:1.0:1787841952.480251:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841952.480253:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246200, rc 0) 00000100:00100000:1.0:1787841952.480512:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10490:x1874687858621952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1041us (1392us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787841952.480520:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 94 00000100:00100000:1.0:1787841952.484036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.484136:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858622208 00000100:00100000:2.0:1787841952.484157:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858622208 00000100:00100000:2.0:1787841952.484429:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:2.0:1787841952.484441:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf802940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10490:x1874687858622208:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1787841952.484867:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf802940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:10490:x1874687858622208:12345-192.168.202.46@tcp:35:cat.0 Request processed in 420us (833us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787841952.484875:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:0.0:1787841952.502283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.502431:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858622464 00000100:00100000:3.0:1787841952.502442:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858622464 00000100:00100000:3.0:1787841952.502573:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 95 00000100:00100000:3.0:1787841952.502583:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:10491:x1874687858622464:12345-192.168.202.46@tcp:36:rm.0 00010000:00010000:3.0:1787841952.502651:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787841952.502703:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13657f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b80 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.502724:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b79 expref: 32 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.502736:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e13651d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b6b expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.502745:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648391b400) 00010000:00010000:3.0:1787841952.502754:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841952.503302:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503318:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503329:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503345:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503352:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503358:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503688:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503697:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.503704:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841952.504261:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787841952.504271:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341478813707ns, next at 342478810912ns, rc = 0 00010000:00010000:3.0:1787841952.504334:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504343:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504351:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504357:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504364:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504370:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504391:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841952.504416:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841952.504426:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504433:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841952.504437:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504445:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504480:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9464999d2b00) 00010000:00010000:3.0:1787841952.504483:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841952.504487:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504493:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1365a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504505:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841952.504507:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841952.504509:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841952.504524:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504530:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504536:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504541:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841952.504544:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504559:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504567:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9464999d2b00) 00010000:00010000:3.0:1787841952.504569:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787841952.504572:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504577:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13659b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504594:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504600:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504606:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504611:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841952.504614:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504619:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504625:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:3.0:1787841952.504626:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841952.504629:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.504643:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13658d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841952.504653:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006469f71d reply state 000000008b8d88aa transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.504662:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841952.504753:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:10491:x1874687858622464:12345-192.168.202.46@tcp:36:rm.0 Request processed in 2168us (2478us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787841952.504761:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 95 00010000:00010000:2.0:1787841952.511883:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.511903:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.511912:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.511918:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.511923:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.511932:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.511950:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9464999d2100) 00010000:00010000:2.0:1787841952.511954:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.511959:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.511966:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136594 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841952.579673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.579804:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858622720 00000100:00100000:2.0:1787841952.579835:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858622720 00000100:00100000:2.0:1787841952.579902:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00100000:2.0:1787841952.579914:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:10497:x1874687858622720:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787841952.579940:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841952.579962:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1365a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b87 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580095:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580110:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580121:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580134:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580141:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580147:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841952.580743:0:8624:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787841952.580908:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580919:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580939:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580972:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580979:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580986:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.580992:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.580997:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.581004:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.581017:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841952.581020:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.581025:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.581031:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841952.581045:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004871bc0a reply state 00000000e496c689 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.581054:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841952.581093:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e1365a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 34 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.581107:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 33 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.581116:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:2.0:1787841952.581118:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841952.581121:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dec00, rc 0) 00000100:00100000:2.0:1787841952.581196:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:10497:x1874687858622720:12345-192.168.202.46@tcp:101:bash.0 Request processed in 1285us (1535us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787841952.581205:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 96 00010000:00010000:3.0:1787841952.587872:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.587894:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.587903:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.587910:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfe00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841952.587915:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.587924:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.587943:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946487ed3a00) 00010000:00010000:3.0:1787841952.587947:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841952.587957:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.587983:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e1365b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841952.588172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.588664:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858622848 00000100:00100000:1.0:1787841952.588674:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858622848 00000100:00100000:1.0:1787841952.588746:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:1.0:1787841952.588757:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858622848:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841952.588788:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841952.588818:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b8e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787841952.588854:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841952.588877:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1787841952.588882:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841952.588894:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.588914:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.588926:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246800, rc 0) 00000100:00100000:1.0:1787841952.588988:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858622848:12345-192.168.202.46@tcp:101:bash.0 Request processed in 233us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841952.588995:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00080000:2.0:1787841952.590018:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841952.598141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.598296:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858622976 00000100:00100000:1.0:1787841952.598306:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858622976 00000100:00100000:1.0:1787841952.598374:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:1.0:1787841952.598384:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:10497:x1874687858622976:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841952.598404:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841952.598421:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b95 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.598454:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.598512:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841952.598517:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841952.598523:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.598561:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.598576:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 7 pid: 6691 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841952.598589:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf8021c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874687877518592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841952.598691:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787841952.600943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.600968:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf8021c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874687877518592:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841952.601003:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.601025:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246a00, rc 0) 00000100:00100000:3.0:1787841952.601026:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858623104 00000100:00100000:3.0:1787841952.601033:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858623104 00010000:00010000:3.0:1787841952.601065:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 8 pid: 6691 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.601086:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:10497:x1874687858622976:12345-192.168.202.46@tcp:101:bash.0 Request processed in 2704us (2955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841952.601094:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:3.0:1787841952.601098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:3.0:1787841952.601106:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858623104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841952.601118:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841952.601140:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 7 pid: 6691 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.601151:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 7 pid: 6691 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.601170:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e1365cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b8e expref: 7 pid: 6691 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.601181:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841952.601185:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841952.601191:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.601197:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.601251:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.601265:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80d2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1874687877518720:192.168.202.46@tcp:105: 00000100:00100000:3.0:1787841952.601329:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841952.606059:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80d2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1874687877518720:192.168.202.46@tcp:105: 00010000:00010000:3.0:1787841952.606095:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841952.606265:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858623104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5159us (5331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.606278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:0.0:1787841952.606563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.607762:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858623360 00000100:00100000:3.0:1787841952.607773:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858623360 00000100:00100000:3.0:1787841952.607938:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:3.0:1787841952.607949:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:10497:x1874687858623360:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:3.0:1787841952.608435:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:10497:x1874687858623360:12345-192.168.202.46@tcp:35:bash.0 Request processed in 486us (1870us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787841952.608443:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:0.0:1787841952.791391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.792339:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858623488 00000100:00100000:2.0:1787841952.792362:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858623488 00000100:00100000:2.0:1787841952.792429:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:2.0:1787841952.792438:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:10513:x1874687858623488:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841952.792490:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841952.792512:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97b9c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.792598:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1365e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.792613:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1365e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.792636:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1365e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841952.792709:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787841952.792713:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841952.792738:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1365e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.792778:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b9c expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.792797:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1365e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b9c expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.792806:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841952.792809:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841952.792813:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dee00, rc 0) 00000100:00100000:2.0:1787841952.792894:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:10513:x1874687858623488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 457us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841952.792902:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:0.0:1787841952.797405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.797505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858623744 00000100:00100000:1.0:1787841952.797516:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858623744 00000100:00100000:1.0:1787841952.797575:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 98 00000100:00100000:1.0:1787841952.797586:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:10513:x1874687858623744:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841952.797608:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841952.797639:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1365e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ba3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.797737:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1365ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.797782:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1365ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.797794:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1365ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841952.797808:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787841952.798496:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1365e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ba3 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.798519:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1365ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ba3 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.798528:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841952.798532:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841952.798535:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246600, rc 0) 00000100:00100000:1.0:1787841952.798657:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:10513:x1874687858623744:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1073us (1262us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787841952.798665:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 98 00000100:00100000:1.0:1787841952.803251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.803333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.803402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624128 00000100:00100000:3.0:1787841952.803412:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624128 00000100:00100000:3.0:1787841952.803507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:3.0:1787841952.803517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:2348:x1874687858624128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841952.803532:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841952.803558:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1365ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ba3 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.803590:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:3.0:1787841952.803595:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841952.803654:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:2348:x1874687858624128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.803663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:2.0:1787841952.805155:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624000 00000100:00100000:2.0:1787841952.805166:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624000 00000100:00100000:2.0:1787841952.805227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 99 00000100:00100000:2.0:1787841952.805245:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:10513:x1874687858624000:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841952.805270:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841952.805288:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97baa expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.805396:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.805411:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.805422:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841952.805433:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787841952.805631:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e1365fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97baa expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.805649:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97baa expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.805657:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:2.0:1787841952.805660:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787841952.805663:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dea00, rc 0) 00000100:00100000:2.0:1787841952.805716:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:10513:x1874687858624000:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 472us (2486us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787841952.805723:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 99 00000100:00100000:1.0:1787841952.810669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.810928:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624256 00000100:00100000:3.0:1787841952.810939:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624256 00000100:00100000:3.0:1787841952.811003:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:3.0:1787841952.811014:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858624256:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1787841952.811064:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.811084:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.811092:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841952.811097:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841952.811101:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.811134:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.811147:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 6 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.811185:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874687877518848:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841952.811336:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841952.816250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.816338:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624384 00000100:00100000:2.0:1787841952.816359:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624384 00002000:00100000:2.0:1787841952.816407:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9464b9956d00 x1874687858624384/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:453/0 lens 504/0 e 0 to 0 dl 1787841963 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841952.816418:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b9956d00 with x1874687858624384 ext(0->8) 00010000:00010000:2.0:1787841952.816426:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 7 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.816443:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 7 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841952.816451:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9464b9956d00 00000100:00100000:2.0:1787841952.816512:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787841952.816522:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858624384:12345-192.168.202.46@tcp:4:lfs.0 00000100:00100000:2.0:1787841952.817039:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858624384:12345-192.168.202.46@tcp:4:lfs.0 Request processed in 518us (808us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787841952.817048:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00002000:00100000:2.0:1787841952.817055:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9464b9956d00 x1874687858624384/t4294967302(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:453/0 lens 504/448 e 0 to 0 dl 1787841963 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841952.817065:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b9956d00 with x1874687858624384 ext(0->8) 00010000:00010000:2.0:1787841952.817070:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 9 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.817083:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 9 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841952.817090:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9464b9956d00 00000100:00100000:3.0:1787841952.817345:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874687877518848:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841952.817370:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.821076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.821190:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624512 00000100:00100000:3.0:1787841952.821200:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624512 00010000:00010000:3.0:1787841952.821247:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 9 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.821306:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 50 00000100:00100000:3.0:1787841952.821315:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2346:x1874687858624512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841952.821330:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787841952.821348:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787841952.821351:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787841953 00002000:00010000:3.0:1787841952.821353:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787841953 00002000:00010000:3.0:1787841952.821356:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787841953 00010000:00010000:3.0:1787841952.821362:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 9 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.821376:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 9 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.821430:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000355cb747/0x1d0ed3605e1365d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b95 expref: 9 pid: 6694 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.821598:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841952.821604:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841952.821611:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.821631:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.821824:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841952.821891:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2346:x1874687858624512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 576us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.821899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 50 00010000:00010000:2.0:1787841952.823174:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823190:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823421:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823432:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823440:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823563:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841952.823569:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823579:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823599:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.823607:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbb6e568/0x1d0ed3605e136612 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.823949:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858624256:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 12933us (13287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841952.823959:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:2.0:1787841952.827663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841952.827870:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624768 00000100:00100000:3.0:1787841952.827882:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624768 00000100:00100000:3.0:1787841952.827946:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:3.0:1787841952.827956:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:10513:x1874687858624768:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:3.0:1787841952.828046:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97baa expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841952.828406:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787841952.828501:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787841952.829012:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787841952.829083:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.829110:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 42 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.829119:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.829160:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 42 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.829188:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 42 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.829203:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874687877518976:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841952.829308:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841952.835102:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.835188:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858624896 00000100:00100000:1.0:1787841952.835197:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858624896 00010000:00010000:1.0:1787841952.835250:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 43 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841952.835314:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:1.0:1787841952.835324:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:2349:x1874687858624896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841952.835342:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841952.835358:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 43 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.835372:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 43 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.835397:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841952.835403:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.835412:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.835419:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.835438:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841952.835522:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:2349:x1874687858624896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 199us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841952.835529:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 51 00010000:00010000:3.0:1787841952.837820:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1365be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b87 expref: 42 pid: 8624 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841952.837907:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874687877518976:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841952.837933:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.837944:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841952.837950:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841952.838806:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787841952.839056:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787841952.839165:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877519104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787841952.839251:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841952.839281:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff946498058b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841952.839644:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877519104 00000100:00100000:0.0:1787841952.839652:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877519104 00000100:00100000:0.0:1787841952.839746:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841952.839757:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1874687877519104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787841952.839856:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1874687877519104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841952.839864:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841952.840046:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877519104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787841952.840558:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787841952.840635:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877519232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787841952.840675:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841952.840694:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648334b840 going to sleep for 11 seconds 00000100:00080000:2.0:1787841952.840969:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841952.841100:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877519232 00000100:00100000:0.0:1787841952.841106:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877519232 00000100:00100000:0.0:1787841952.841146:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841952.841156:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1874687877519232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787841952.841588:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5853:x1874687877519232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 432us (910us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787841952.841596:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841952.842036:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877519232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787841952.842113:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787841952.842165:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.842186:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.842193:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.842200:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841952.842204:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.842213:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.842243:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841952.842247:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787841952.842253:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841952.842260:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136619 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787841952.842835:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787841952.843081:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787841952.843095:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341817637990ns, next at 342817635551ns, rc = 0 00000001:00080000:1.0:1787841952.843104:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787841952.843146:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841952.843149:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787841952.843158:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97baa expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841952.843305:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:10513:x1874687858624768:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 15349us (15653us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787841952.843314:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 26 00000020:00080000:1.0:1787841952.843319:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787841952.847825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.848072:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858625024 00000100:00100000:2.0:1787841952.848084:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858625024 00000100:00100000:2.0:1787841952.848177:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 100 00000100:00100000:2.0:1787841952.848189:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:10513:x1874687858625024:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841952.848214:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841952.848248:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136620 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bb1 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.848310:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136620 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bb1 expref: 46 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.848325:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136620 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bb1 expref: 46 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.848343:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841952.848346:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841952.848350:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841952.848483:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:10513:x1874687858625024:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 297us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841952.848490:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 100 00000100:00100000:0.0:1787841952.853547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841952.853742:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858625280 00000100:00100000:1.0:1787841952.853763:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858625280 00000100:00100000:1.0:1787841952.853838:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:1.0:1787841952.854071:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:10513:x1874687858625280:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841952.854343:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10513:x1874687858625280:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 277us (805us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787841952.854361:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:0.0:1787841952.962726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841952.962943:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858625408 00000100:00100000:2.0:1787841952.962953:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858625408 00000100:00100000:2.0:1787841952.963018:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:2.0:1787841952.963027:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10522:x1874687858625408:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:2.0:1787841952.963108:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963126:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963140:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963154:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963161:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963167:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963277:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963286:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963292:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841952.963337:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963369:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963374:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963381:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963386:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.963390:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963397:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963411:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841952.963414:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.963420:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963426:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963440:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963446:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963451:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963513:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.963516:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963522:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963530:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946487ed3b00) 00010000:00010000:2.0:1787841952.963533:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.963535:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963541:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13662e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963557:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963563:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963569:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963573:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841952.963576:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963583:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963614:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841952.963617:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841952.963620:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841952.963637:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e136635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841952.963726:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10522:x1874687858625408:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 699us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841952.963735:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:0.0:1787841953.001714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841953.001822:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858625664 00000100:00100000:1.0:1787841953.001832:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858625664 00000100:00100000:1.0:1787841953.001931:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 102 00000100:00100000:1.0:1787841953.001943:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:10526:x1874687858625664:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841953.001966:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841953.001991:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e13663c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bb8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002071:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002086:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002098:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002126:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002133:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002139:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002280:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002289:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002297:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841953.002306:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787841953.002412:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002419:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002425:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002432:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841953.002437:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002488:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002503:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841953.002505:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841953.002510:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002517:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002532:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002538:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002544:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002549:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841953.002552:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002557:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002564:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317a700) 00010000:00010000:1.0:1787841953.002567:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841953.002569:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002586:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13664a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002632:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e13663c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bb8 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002646:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bb8 expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.002655:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841953.002657:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841953.002659:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247c00, rc 0) 00000100:00100000:1.0:1787841953.002728:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:10526:x1874687858625664:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 787us (1022us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787841953.002736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 102 00000100:00080000:2.0:1787841953.003423:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841953.005503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.005600:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858625792 00000100:00100000:2.0:1787841953.005609:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858625792 00000100:00100000:2.0:1787841953.005655:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 103 00000100:00100000:2.0:1787841953.005665:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:10526:x1874687858625792:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:2.0:1787841953.005727:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005741:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005752:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005789:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005797:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005817:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005822:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841953.005826:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005833:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005854:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.005858:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841953.005862:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.005868:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13665f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841953.005940:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:10526:x1874687858625792:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 277us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841953.005948:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 103 00000100:00100000:0.0:1787841953.008646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841953.008802:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858626048 00000100:00100000:3.0:1787841953.008812:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858626048 00000100:00100000:3.0:1787841953.008882:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 28 00000100:00100000:3.0:1787841953.008892:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:10526:x1874687858626048:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841953.009146:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10526:x1874687858626048:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 256us (509us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787841953.009154:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 28 00000001:00080000:1.0:1787841953.110730:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787841953.110770:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787841953.134748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841953.135133:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858626304 00000100:00100000:3.0:1787841953.135144:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858626304 00000100:00100000:3.0:1787841953.135204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 104 00000100:00100000:3.0:1787841953.135214:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9955a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:10536:x1874687858626304:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841953.135266:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841953.135269:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841953.135300:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1365e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b9c expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.135337:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:3.0:1787841953.135401:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841953.135416:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136666 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bbf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.135656:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e13666d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.135671:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e13666d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.135681:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e13666d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841953.135692:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787841953.136036:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136666 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bbf expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.136056:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e13666d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bbf expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.136063:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841953.136065:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841953.136068:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030200, rc 0) 00000100:00100000:2.0:1787841953.136431:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9955a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10536:x1874687858626304:12345-192.168.202.46@tcp:101:bash.0 Request processed in 1215us (1690us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787841953.136441:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 104 00000100:00100000:0.0:1787841953.141220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.141322:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858626560 00000100:00100000:2.0:1787841953.141332:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858626560 00000100:00100000:2.0:1787841953.141401:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 105 00000100:00100000:2.0:1787841953.141413:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10536:x1874687858626560:12345-192.168.202.46@tcp:36:bash.0 00010000:00010000:2.0:1787841953.141519:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787841953.141551:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e13666d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bbf expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.141576:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bb8 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.141587:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.141593:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841953.142401:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.142418:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.142428:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841953.142525:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787841953.142552:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c539ab17 reply state 00000000744fd75c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841953.142562:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841953.143734:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10536:x1874687858626560:12345-192.168.202.46@tcp:36:bash.0 Request processed in 2206us (2406us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787841953.143745:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 105 00000020:00080000:2.0:1787841953.143752:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787841953.146659:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.146698:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.146706:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.146711:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841953.146717:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.146725:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.146743:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.146746:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841953.146751:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.147029:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13667b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841953.150121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841953.150705:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858626688 00000100:00100000:3.0:1787841953.150717:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858626688 00000100:00100000:3.0:1787841953.150818:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 106 00000100:00100000:3.0:1787841953.150830:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:10536:x1874687858626688:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841953.150882:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841953.150915:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bc6 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.151009:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.151023:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.151035:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841953.151065:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787841953.151070:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841953.151090:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.151120:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 53 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.151142:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 52 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.151150:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841953.151153:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841953.151156:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498c00, rc 0) 00000100:00100000:3.0:1787841953.151223:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10536:x1874687858626688:12345-192.168.202.46@tcp:101:bash.0 Request processed in 396us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841953.151239:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 106 00000100:00100000:0.0:1787841953.158735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841953.159012:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858626944 00000100:00100000:3.0:1787841953.159023:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858626944 00000100:00100000:3.0:1787841953.159084:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:3.0:1787841953.159095:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:10536:x1874687858626944:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:3.0:1787841953.159488:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10536:x1874687858626944:12345-192.168.202.46@tcp:35:bash.0 Request processed in 362us (729us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787841953.159497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:0.0:1787841953.233319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841953.233562:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858627072 00000100:00100000:3.0:1787841953.233574:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858627072 00000100:00100000:3.0:1787841953.233645:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 107 00000100:00100000:3.0:1787841953.233656:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:10542:x1874687858627072:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1787841953.233686:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841953.233708:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bcd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.234208:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.234236:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.234249:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841953.234310:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787841953.234314:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841953.234339:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.234377:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bcd expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.234411:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bcd expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.234420:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:3.0:1787841953.234423:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841953.234426:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499a00, rc 0) 00000100:00100000:2.0:1787841953.235494:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10542:x1874687858627072:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1100us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841953.235506:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 107 00000100:00100000:0.0:1787841953.238903:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.239311:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858627200 00000100:00100000:2.0:1787841953.239321:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858627200 00000100:00100000:2.0:1787841953.239384:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 108 00000100:00100000:2.0:1787841953.239395:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10542:x1874687858627200:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841953.239418:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841953.239453:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13669e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239548:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239563:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239574:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239588:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239595:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239601:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239716:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239725:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239732:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841953.239782:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787841953.239787:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841953.239807:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239828:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239849:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239857:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239864:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239870:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841953.239875:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239883:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.239896:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841953.239899:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841953.239904:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240176:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240191:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240198:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240211:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240217:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841953.240220:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240257:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240267:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946487ed3f00) 00010000:00010000:2.0:1787841953.240270:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841953.240274:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240281:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240318:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e13669e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240332:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.240340:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.240342:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841953.240345:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df200, rc 0) 00000100:00100000:2.0:1787841953.240416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10542:x1874687858627200:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1023us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841953.240433:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 108 00000100:00100000:0.0:1787841953.244967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.245099:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858627456 00000100:00100000:2.0:1787841953.245109:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858627456 00000100:00100000:2.0:1787841953.245165:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 109 00000100:00100000:2.0:1787841953.245174:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10542:x1874687858627456:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841953.245195:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841953.245216:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1366ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bdb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245330:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245356:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245365:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245373:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245406:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245418:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 56 pid: 5849 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841953.245430:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877519360:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841953.245585:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.245594:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841953.245603:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877519488:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841953.245626:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841953.248853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841953.248957:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858627584 00000100:00100000:3.0:1787841953.248968:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858627584 00010000:00010000:3.0:1787841953.249019:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 57 pid: 5849 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841953.249067:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:3.0:1787841953.249078:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:2348:x1874687858627584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841953.249094:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841953.249101:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 57 pid: 5849 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.249114:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 57 pid: 5849 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.249138:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841953.249143:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.249152:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841953.249179:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841953.249261:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:2348:x1874687858627584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 183us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841953.249270:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 52 00010000:00010000:2.0:1787841953.252115:0:5850:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from blocking AST (req@0000000010077bc4 x1874687877519360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 56 pid: 5849 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.252140:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bd4 expref: 56 pid: 5849 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841953.252159:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877519360:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841953.252175:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877519488:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841953.252201:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.252207:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.252216:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.252236:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841953.254240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.254317:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858627712 00000100:00100000:2.0:1787841953.254350:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858627712 00010000:00010000:2.0:1787841953.254385:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841953.254424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:2.0:1787841953.254433:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:2349:x1874687858627712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841953.254449:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841953.254488:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.254501:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.254523:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bc6 expref: 56 pid: 8624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.254538:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.254542:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.254551:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.254559:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.254581:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841953.254642:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:2349:x1874687858627712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 209us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841953.254658:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 53 00010000:00010000:0.0:1787841953.254934:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841953.254943:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841953.254964:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787841953.255116:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dee00/0x1d0ed3605e1366ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841953.255132:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841953.255140:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:0.0:1787841953.255143:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787841953.255145:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dea00, rc 0) 00000100:00100000:0.0:1787841953.255185:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10542:x1874687858627456:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 10012us (10229us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787841953.255192:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 109 00000100:00100000:0.0:1787841953.264564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841953.264692:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858627968 00000100:00100000:1.0:1787841953.264703:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858627968 00000100:00100000:1.0:1787841953.264775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:1.0:1787841953.264786:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10542:x1874687858627968:12345-192.168.202.46@tcp:103:lfs.0 00010000:00010000:1.0:1787841953.264803:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841953.264831:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bb1 expref: 55 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841953.264882:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841953.264888:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841953.264970:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10542:x1874687858627968:12345-192.168.202.46@tcp:103:lfs.0 Request processed in 185us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841953.264979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00010000:00010000:0.0:1787841953.265665:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841953.268560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.268718:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628096 00000100:00100000:2.0:1787841953.268730:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628096 00000100:00100000:2.0:1787841953.268803:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 110 00000100:00100000:2.0:1787841953.268815:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10542:x1874687858628096:12345-192.168.202.46@tcp:58:lfs.0 00010000:00010000:2.0:1787841953.269102:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.269124:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.269137:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787841953.269373:0:8624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787841953.271784:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10542:x1874687858628096:12345-192.168.202.46@tcp:58:lfs.0 Request processed in 2957us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841953.271801:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 110 00000100:00100000:0.0:1787841953.274396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841953.275082:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628224 00000100:00100000:2.0:1787841953.275093:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628224 00000100:00100000:2.0:1787841953.275196:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 111 00000100:00100000:2.0:1787841953.275206:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:10542:x1874687858628224:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841953.275236:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841953.275259:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97be2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.275328:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.275363:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.275382:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.275396:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.275409:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841953.275413:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841953.275417:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841953.275425:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de600, rc 0) 00000100:00100000:2.0:1787841953.275508:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10542:x1874687858628224:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 303us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841953.275516:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 111 00000100:00100000:0.0:1787841954.069534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.069667:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628352 00000100:00100000:1.0:1787841954.069678:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628352 00000100:00100000:1.0:1787841954.069742:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 295 00000100:00100000:1.0:1787841954.069753:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858628352:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841954.070394:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858628352:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 641us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.070404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 295 00000100:00100000:3.0:1787841954.072630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.072675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.072778:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628608 00000100:00100000:2.0:1787841954.072787:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628608 00000100:00100000:2.0:1787841954.072868:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:2.0:1787841954.072878:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858628608:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841954.072951:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858628608:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.072958:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:3.0:1787841954.073301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1787841954.073356:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841954.075621:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841954.075770:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628736 00000100:00100000:0.0:1787841954.075792:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628736 00000100:00100000:0.0:1787841954.075870:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:0.0:1787841954.075881:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858628736:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841954.075978:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858628736:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.075986:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00080000:3.0:1787841954.077016:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841954.077679:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628480 00000100:00100000:1.0:1787841954.077692:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628480 00000100:00100000:1.0:1787841954.077761:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628864 00000100:00100000:1.0:1787841954.077773:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628864 00000100:00100000:1.0:1787841954.077824:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 150 00000100:00100000:1.0:1787841954.077845:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:2349:x1874687858628480:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841954.077940:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:2349:x1874687858628480:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 97us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.077948:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 150 00000100:00080000:3.0:1787841954.078664:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841954.078739:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 151 00000100:00100000:1.0:1787841954.078755:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858628864:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841954.078810:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858628864:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 61us (5509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.083421:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 151 00000040:00080000:3.0:1787841954.161782:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841954.161792:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841954.161842:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787841954.161851:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787841954.163823:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877519616:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787841954.164012:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bae00f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841954.173330:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877519616:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841954.182951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.183523:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858628992 00000100:00100000:2.0:1787841954.183550:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858628992 00000100:00100000:2.0:1787841954.183632:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 112 00000100:00100000:2.0:1787841954.183643:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10543:x1874687858628992:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841954.183677:0:5850:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841954.183793:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10543:x1874687858628992:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 152us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.183804:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 112 00000100:00100000:3.0:1787841954.196144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.196270:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858629120 00000100:00100000:2.0:1787841954.196281:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858629120 00000100:00100000:2.0:1787841954.196360:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 113 00000100:00100000:2.0:1787841954.196370:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10543:x1874687858629120:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.196491:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196511:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196526:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196572:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196581:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196587:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196612:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196632:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196640:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841954.196946:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787841954.196952:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841954.196966:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196978:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196985:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196991:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.196997:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.197001:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197008:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197020:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:2.0:1787841954.197024:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841954.197029:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197046:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1366dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197061:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197066:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197072:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197077:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.197080:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197086:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197094:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff946487ed3f00) 00010000:00010000:2.0:1787841954.197097:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841954.197100:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197106:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1366e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197120:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197126:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197139:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197145:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dec00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.197147:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197153:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197161:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841954.197164:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841954.197167:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.197173:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e1366eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.197267:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10543:x1874687858629120:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 Request processed in 896us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.197275:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 113 00000100:00100000:0.0:1787841954.203420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.203573:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858629376 00000100:00100000:3.0:1787841954.203584:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858629376 00000100:00100000:3.0:1787841954.203653:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 114 00000100:00100000:3.0:1787841954.203665:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:10543:x1874687858629376:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841954.203687:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841954.203708:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1366f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97be9 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204049:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204066:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204076:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841954.204088:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787841954.204190:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204198:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204205:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204212:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841954.204231:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204239:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204252:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841954.204255:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841954.204260:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204276:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1366f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204319:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1366f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be9 expref: 57 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204329:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:3.0:1787841954.204332:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841954.204336:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1366f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be9 expref: 57 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.204345:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:3.0:1787841954.204420:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10543:x1874687858629376:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 756us (1009us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787841954.204427:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 114 00000100:00100000:0.0:1787841954.209719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.210014:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858629504 00000100:00100000:1.0:1787841954.210026:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858629504 00000100:00100000:1.0:1787841954.210098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 115 00000100:00100000:1.0:1787841954.210109:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10543:x1874687858629504:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787841954.210158:0:5849:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787841954.210294:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10543:x1874687858629504:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 187us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.210302:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 115 00000100:00100000:0.0:1787841954.218777:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.218924:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858629760 00000100:00100000:2.0:1787841954.218936:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858629760 00000100:00100000:2.0:1787841954.218998:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:2.0:1787841954.219010:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10543:x1874687858629760:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.219031:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841954.219034:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787841954.219064:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bcd expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.219102:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:2.0:1787841954.219107:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841954.219122:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136707 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841954.219635:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787841954.220235:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13670e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.220253:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13670e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.220264:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13670e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.220324:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136707 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf0 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.221172:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13670e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf0 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.221182:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:2.0:1787841954.221185:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841954.221188:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df000, rc 0) 00000100:00100000:2.0:1787841954.221277:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10543:x1874687858629760:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 2270us (2509us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787841954.221287:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:0.0:1787841954.231104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.231205:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858630016 00000100:00100000:1.0:1787841954.231224:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858630016 00000100:00100000:1.0:1787841954.231288:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:1.0:1787841954.231299:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10543:x1874687858630016:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841954.231368:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841954.231395:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e13670e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf0 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231415:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:1.0:1787841954.231425:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841954.231448:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231513:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231543:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231594:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231602:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231609:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231699:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231706:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231712:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231718:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841954.231722:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231728:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.231737:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841954.231740:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841954.231743:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232037:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13671c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232051:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232057:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232062:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232066:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841954.232070:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232076:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232084:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf7ec9740 (ffff94649317a700) 00010000:00010000:1.0:1787841954.232086:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841954.232089:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.232094:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf7ec9740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.232170:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10543:x1874687858630016:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 871us (1075us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787841954.232178:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:0.0:1787841954.235007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.235102:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858630144 00000100:00100000:2.0:1787841954.235111:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858630144 00000100:00100000:2.0:1787841954.235179:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 118 00000100:00100000:2.0:1787841954.235189:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:10543:x1874687858630144:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.235210:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841954.235242:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13672a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bf7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.235277:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.235289:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.235299:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.235403:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13672a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.235422:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.235430:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:2.0:1787841954.235433:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841954.235436:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de400, rc 0) 00000100:00100000:2.0:1787841954.235529:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10543:x1874687858630144:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 341us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.235536:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 118 00000100:00100000:0.0:1787841954.238598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.238693:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858630400 00000100:00100000:2.0:1787841954.238702:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858630400 00000100:00100000:2.0:1787841954.238769:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 119 00000100:00100000:2.0:1787841954.238780:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:10543:x1874687858630400:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.238883:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.238897:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.238908:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787841954.239127:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787841954.239138:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343213679850ns, next at 344213676854ns, rc = 0 00000004:00010000:2.0:1787841954.239412:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d9b40c3 reply state 0000000092fe293b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.239422:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841954.239534:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:10543:x1874687858630400:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 755us (945us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787841954.239543:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 119 00010000:00010000:3.0:1787841954.242753:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.242878:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.242886:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.242892:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841954.242896:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.242905:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.242938:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:3.0:1787841954.242942:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841954.242947:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.242953:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.256088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.256310:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858630528 00000100:00100000:2.0:1787841954.256321:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858630528 00000100:00100000:2.0:1787841954.256383:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 120 00000100:00100000:2.0:1787841954.256394:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:10543:x1874687858630528:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.256420:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841954.256441:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.256572:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.256588:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.256608:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:2.0:1787841954.256611:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841954.256615:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dec00, rc 0) 00000100:00100000:2.0:1787841954.256673:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:10543:x1874687858630528:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 281us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.256680:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 120 00000100:00100000:0.0:1787841954.264452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.264716:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858630656 00000100:00100000:2.0:1787841954.264726:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858630656 00000100:00100000:2.0:1787841954.264779:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:2.0:1787841954.264788:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858630656:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787841954.265116:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858630656:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 328us (676us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787841954.265125:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:0.0:1787841954.273829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.273924:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858630912 00000100:00100000:1.0:1787841954.273935:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858630912 00000100:00100000:1.0:1787841954.273999:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 30 00000100:00100000:1.0:1787841954.274010:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:10543:x1874687858630912:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787841954.274329:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:10543:x1874687858630912:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 321us (509us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787841954.274339:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 30 00000100:00100000:3.0:1787841954.277236:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.277346:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858631168 00000100:00100000:1.0:1787841954.277355:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858631168 00000100:00100000:1.0:1787841954.277406:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:1.0:1787841954.277415:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:10543:x1874687858631168:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841954.277554:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:10543:x1874687858631168:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 139us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.277564:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:0.0:1787841954.282402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.282741:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858631296 00000100:00100000:2.0:1787841954.282751:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858631296 00000100:00100000:2.0:1787841954.283050:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:2.0:1787841954.283061:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:10543:x1874687858631296:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.283084:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841954.283121:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c05 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.283194:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e13674d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.283208:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e13674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.283230:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e13674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841954.283269:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841954.283287:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e13674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.283314:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c05 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.283346:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e13674d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c05 expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.283356:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:2.0:1787841954.283359:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787841954.283363:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfe00, rc 0) 00000100:00100000:2.0:1787841954.283525:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:10543:x1874687858631296:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 465us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.283533:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:0.0:1787841954.287025:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.287279:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858631424 00000100:00100000:2.0:1787841954.287288:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858631424 00000100:00100000:2.0:1787841954.287496:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:2.0:1787841954.287508:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2348:x1874687858631424:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841954.287526:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841954.287547:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c0c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841954.287573:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904da3, blocks: 0x1 00010000:00010000:2.0:1787841954.287593:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1787841954.287597:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841954.287606:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.287625:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.287638:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841954.287702:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2348:x1874687858631424:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 197us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.287710:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 38 00010000:00010000:1.0:1787841954.289726:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841954.290249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.290340:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858631680 00000100:00100000:1.0:1787841954.290350:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858631680 00000100:00100000:1.0:1787841954.290409:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 123 00000100:00100000:1.0:1787841954.290419:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:10543:x1874687858631680:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841954.290541:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:10543:x1874687858631680:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 123us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.290550:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 123 00000100:00100000:3.0:1787841954.299009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841954.299098:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858631808 00000100:00100000:0.0:1787841954.299109:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858631808 00000100:00100000:0.0:1787841954.299176:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:0.0:1787841954.299187:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:10543:x1874687858631808:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841954.299212:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841954.299250:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c13 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.299279:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.299286:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841954.299289:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841954.299293:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.299318:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.299328:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.299347:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcf840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1874687877519744:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841954.299417:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff946486013d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841954.301041:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcf840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1874687877519744:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841954.301071:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.301087:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480a00, rc 0) 00000100:00100000:0.0:1787841954.301143:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:10543:x1874687858631808:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 1956us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.301165:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:3.0:1787841954.306512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.306615:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858631936 00000100:00100000:1.0:1787841954.306627:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858631936 00010000:00010000:1.0:1787841954.306670:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.306734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 54 00000100:00100000:1.0:1787841954.306744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:2349:x1874687858631936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841954.306772:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841954.306798:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.306812:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.306848:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be198d5b/0x1d0ed3605e136754 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c0c expref: 11 pid: 6694 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.306865:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841954.306870:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841954.306877:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.306889:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.306928:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.306943:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1874687877519872:192.168.202.46@tcp:105: 00000100:00100000:1.0:1787841954.307028:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b9b3f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841954.311257:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1874687877519872:192.168.202.46@tcp:105: 00010000:00010000:1.0:1787841954.311287:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841954.311354:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2349:x1874687858631936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4610us (4899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.311365:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 54 00000100:00100000:0.0:1787841954.319248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.319495:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858632064 00000100:00100000:2.0:1787841954.319505:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858632064 00002000:00100000:2.0:1787841954.319558:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9464bfbcf840 x1874687858632064/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:455/0 lens 504/0 e 0 to 0 dl 1787841965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841954.319571:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464bfbcf840 with x1874687858632064 ext(0->12) 00002000:00010000:2.0:1787841954.319577:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464bfbcf840 00000100:00100000:2.0:1787841954.319612:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:2.0:1787841954.319634:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2349:x1874687858632064:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787841954.320099:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:2349:x1874687858632064:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 Request processed in 464us (859us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787841954.320108:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00002000:00100000:2.0:1787841954.320115:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9464bfbcf840 x1874687858632064/t4294967308(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:455/0 lens 504/448 e 0 to 0 dl 1787841965 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841954.320122:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464bfbcf840 with x1874687858632064 ext(0->12) 00002000:00010000:2.0:1787841954.320126:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464bfbcf840 00000100:00100000:3.0:1787841954.325178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.326004:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858632192 00000100:00100000:2.0:1787841954.326017:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858632192 00000100:00100000:2.0:1787841954.326088:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 124 00000100:00100000:2.0:1787841954.326100:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:10543:x1874687858632192:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787841954.459526:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:10543:x1874687858632192:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 Request processed in 133414us (134356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.459541:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 124 00000001:00080000:1.0:1787841954.459579:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000001:00080000:1.0:1787841954.459599:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787841954.459616:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787841954.459647:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787841954.459665:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787841954.459707:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9464980583c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787841954.459712:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946498058b40 00000020:00080000:1.0:1787841954.459715:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff946485536400 00000004:00080000:1.0:1787841954.459735:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787841954.459775:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946489b08a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787841954.459778:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394e400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946489b08d80 00000020:00080000:1.0:1787841954.459781:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464c0086c00 00000100:00100000:3.0:1787841954.459799:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877520000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787841954.459876:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877520128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787841954.459885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.459906:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787841954.459961:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1787841954.460061:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877520256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787841954.460103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.460128:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877520000 00000100:00100000:1.0:1787841954.460135:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877520000 00000020:00080000:2.0:1787841954.460160:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787841954.460175:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877520128 00000100:00100000:1.0:1787841954.460178:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877520128 00000100:00100000:1.0:1787841954.460193:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877520256 00000100:00100000:1.0:1787841954.460196:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877520256 00000100:00100000:1.0:1787841954.460208:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787841954.460227:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877520000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787841954.460258:0:6691:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1787841954.460296:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a904da1, atime: 0x6a904da1, ctime: 0x6a904da1, blocks: 0xb 00010000:00010000:1.0:1787841954.460304:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787841954.460314:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841954.460319:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787841954.460323:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00000100:00100000:3.0:1787841954.464268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.464734:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787841954.464746:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:1.0:1787841954.464901:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841954.464915:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.464939:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.464951:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.464960:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.465004:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841954.465050:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841954.465057:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.465065:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841954.465069:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.465077:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.465096:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.465103:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e136762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.465124:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841954.465125:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841954.465127:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841954.465325:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858632320 00000100:00100000:2.0:1787841954.465342:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858632320 00000100:00100000:3.0:1787841954.465544:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787841954.465557:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1874687877520128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787841954.465588:0:12012:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787841954.465608:0:12012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.465624:0:12012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.465645:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00000100:00100000:1.0:1787841954.465645:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877520000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5429us (5759us total) trans 4294967304 rc 0/0 00010000:00010000:3.0:1787841954.465648:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841954.465652:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.465653:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787841954.465674:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787841954.465681:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1874687877520256:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787841954.465687:0:12012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.465701:0:12012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 12 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.465716:0:12012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ba1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12012:1874687877520384:192.168.202.46@tcp:104: 00002000:00010000:1.0:1787841954.465782:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787841954.465785:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787841955 00002000:00010000:1.0:1787841954.465788:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787841954.465789:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787841955 -> 1787841955 00002000:00010000:1.0:1787841954.465791:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787841954.465953:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787841954.465960:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1787841954.465979:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464bf80e580, transno 4294967301 00000004:00080000:2.0:1787841954.465990:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1787841954.466007:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff94648847f840 x1874687877520000/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787841970 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787841954.466019:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94648847f840/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787841954.466025:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877520000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787841954.466583:0:12012:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b912a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841954.468509:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1874687877520256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2816us (8392us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787841954.468524:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787841954.468564:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:1.0:1787841954.468593:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:2347:x1874687858632320:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787841954.469536:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464b9955e00/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787841954.469546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877520256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787841954.473928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.473966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858632448 00000100:00100000:3.0:1787841954.474642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858632448 00010000:00010000:3.0:1787841954.474691:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 13 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.474737:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:3.0:1787841954.474747:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2349:x1874687858632448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841954.475823:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841954.475846:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 13 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.475865:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 13 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.475894:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841954.475899:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841954.475906:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.475916:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.475938:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841954.475993:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2349:x1874687858632448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1247us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.476003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 55 00010000:00010000:3.0:1787841954.480663:0:12012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d872587/0x1d0ed3605e136524 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b72 expref: 12 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.480690:0:12012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ba1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12012:1874687877520384:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841954.480715:0:12012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.480727:0:12012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.480747:0:12012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.482742:0:12012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.482774:0:12012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.482803:0:12012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841954.484440:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841954.484451:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.484479:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841954.484484:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.484493:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.484514:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.484521:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b94986b/0x1d0ed3605e136769 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.484543:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841954.484544:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841954.484546:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787841954.493998:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464b99561c0/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787841954.494014:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877520128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787841954.495813:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1874687877520128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30249us (35894us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787841954.495829:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000001:00080000:2.0:1787841954.517426:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787841954.517445:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1787841954.517451:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787841954.517710:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858632320:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 Request processed in 49115us (53446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.517722:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:3.0:1787841954.520483:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.520558:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858632704 00000100:00100000:1.0:1787841954.520568:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858632704 00000100:00100000:1.0:1787841954.520700:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 125 00000100:00100000:1.0:1787841954.520711:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:10543:x1874687858632704:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841954.520782:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841954.520810:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e13674d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c05 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.521069:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:1.0:1787841954.521075:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841954.521107:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.521120:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.521129:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841954.521448:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045783845 reply state 000000009f93c51d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.521509:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841954.521856:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:10543:x1874687858632704:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 1144us (1397us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787841954.521866:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 125 00000100:00100000:0.0:1787841954.526868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.527397:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858632832 00000100:00100000:3.0:1787841954.527408:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858632832 00000100:00100000:3.0:1787841954.527497:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:3.0:1787841954.527509:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858632832:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787841954.527737:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787841954.527742:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787841955 -> 1787841953 00002000:00010000:3.0:1787841954.527744:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787841953 00002000:00010000:3.0:1787841954.527747:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787841955 -> 1787841953 00002000:00010000:3.0:1787841954.527771:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787841954.527844:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858632832:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 336us (987us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787841954.527852:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:0.0:1787841954.530190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.530292:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633088 00000100:00100000:1.0:1787841954.530303:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633088 00000100:00100000:1.0:1787841954.530362:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 126 00000100:00100000:1.0:1787841954.530372:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:10543:x1874687858633088:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787841954.530447:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.530501:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.530532:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.530576:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.530590:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.530606:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9957840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877520512:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841954.530691:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b300 going to sleep for 11 seconds 00010000:00010000:2.0:1787841954.532202:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.532248:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.532254:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.532260:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.532265:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.532273:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.532289:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:2.0:1787841954.532292:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841954.532296:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.532302:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136770 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.534453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.534570:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633216 00000100:00100000:2.0:1787841954.534580:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633216 00010000:00010000:2.0:1787841954.534619:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.534659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 56 00000100:00100000:2.0:1787841954.534669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:2349:x1874687858633216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841954.534685:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841954.534704:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.534718:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.534737:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:2.0:1787841954.534743:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.534752:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.534770:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.534788:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841954.534855:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:2349:x1874687858633216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 187us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.534863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 56 00010000:00010000:0.0:1787841954.535391:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bf7 expref: 15 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.535424:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9957840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877520512:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841954.535445:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535487:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535495:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535527:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535533:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535540:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535546:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841954.535551:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535559:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535569:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:0.0:1787841954.535572:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787841954.535577:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.535592:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246400/0x1d0ed3605e136777 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.535658:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:10543:x1874687858633088:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 Request processed in 5286us (5480us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787841954.535667:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 126 00000100:00100000:3.0:1787841954.538919:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841954.539698:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633344 00000100:00100000:0.0:1787841954.539711:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633344 00000100:00100000:0.0:1787841954.539810:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:0.0:1787841954.539820:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858633344:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787841954.539873:0:12012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.539892:0:12012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.539901:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841954.539906:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841954.539910:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.539945:0:12012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.539960:0:12012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 7 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.539994:0:12012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b995b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12012:1874687877520640:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841954.540082:0:12012:0:(client.c:2715:ptlrpc_set_wait()) set ffff946486013d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.543943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.544538:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633472 00000100:00100000:3.0:1787841954.544548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633472 00010000:00010000:3.0:1787841954.544593:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 8 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.544638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:3.0:1787841954.544648:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858633472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841954.544663:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841954.544686:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 8 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.544702:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 8 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.544725:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841954.544730:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841954.544736:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.544746:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.544800:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841954.544873:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858633472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 226us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.544881:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 57 00010000:00010000:0.0:1787841954.546189:0:12012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e13675b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c13 expref: 7 pid: 6693 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.546220:0:12012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b995b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12012:1874687877520640:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841954.546246:0:12012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546257:0:12012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546264:0:12012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546295:0:12012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546305:0:12012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546313:0:12012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546349:0:12012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841954.546353:0:12012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546361:0:12012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546377:0:12012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.546384:0:12012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e13677e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.546501:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858633344:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 Request processed in 6682us (7594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.546511:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:2.0:1787841954.552072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.552161:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633728 00000100:00100000:3.0:1787841954.552172:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633728 00000100:00100000:3.0:1787841954.552243:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 127 00000100:00100000:3.0:1787841954.552254:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:10543:x1874687858633728:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787841954.552351:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552369:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552381:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552625:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552636:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552645:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552682:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.552717:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 15 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.552733:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877520768:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841954.552818:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b912a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.556107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.556229:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877520768:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841954.556260:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.556345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633856 00000100:00100000:0.0:1787841954.556352:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633856 00010000:00010000:0.0:1787841954.556388:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.556426:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 58 00000100:00100000:0.0:1787841954.556436:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:2349:x1874687858633856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841954.556452:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841954.556508:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.556521:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.556543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e13673f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bfe expref: 16 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.556559:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:0.0:1787841954.556565:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.556574:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.556582:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.556607:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841954.556659:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:2349:x1874687858633856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 223us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.556666:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 58 00010000:00010000:2.0:1787841954.557256:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.557265:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841954.557498:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787841954.557644:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787841954.557703:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787841954.557803:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874687877520896:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787841954.558023:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841954.558058:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464836239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841954.558161:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877520896 00000100:00100000:0.0:1787841954.558169:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877520896 00000100:00100000:0.0:1787841954.558312:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841954.558322:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1874687877520896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787841954.558416:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1874687877520896:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.558435:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787841954.559373:0:5851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787841954.559381:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1787841954.559406:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464b9955e00, transno 4294967309 00000100:00100000:2.0:1787841954.559429:0:5851:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9464b99561c0 x1874687877520128/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787841970 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841954.559442:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874687877520896:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787841954.560017:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787841954.560101:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874687877521024:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787841954.560157:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841954.561632:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.561687:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877521024 00000100:00100000:3.0:1787841954.561696:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877521024 00000100:00100000:3.0:1787841954.561749:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841954.561816:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1874687877521024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787841954.562180:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5851:x1874687877521024:12345-0@lo:1000:mdt00_002.0 Request processed in 422us (2021us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787841954.562188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841954.562451:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874687877521024:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787841954.562607:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562617:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562624:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562630:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.562635:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562643:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562678:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946487ed3b00) 00010000:00010000:2.0:1787841954.562682:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841954.562687:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562694:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13678c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562729:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562736:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562743:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562748:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.562751:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562901:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562912:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841954.562915:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841954.562922:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562934:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562953:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.562991:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.563005:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877521152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1787841954.563125:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946498058b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.567048:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.567118:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858633984 00000100:00100000:1.0:1787841954.567127:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858633984 00000100:00100000:1.0:1787841954.567186:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:1.0:1787841954.567196:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10542:x1874687858633984:12345-192.168.202.46@tcp:49:lfs.0 00000100:00100000:1.0:1787841954.567354:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:10542:x1874687858633984:12345-192.168.202.46@tcp:49:lfs.0 Request processed in 159us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.567362:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:3.0:1787841954.569796:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877521152:192.168.202.46@tcp:105: 00010000:00010000:3.0:1787841954.569886:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.569898:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e1366cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570134:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570150:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570160:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570171:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570177:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570183:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570189:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfe00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.570192:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570225:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570237:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841954.570240:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841954.570244:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570250:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136793 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570259:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570266:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570272:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570277:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841954.570279:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570284:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570291:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841954.570294:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841954.570296:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.570311:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.570971:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:10543:x1874687858633728:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 18716us (18907us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787841954.570984:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 127 00000020:00080000:2.0:1787841954.570991:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787841954.571139:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841954.571144:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841954.571673:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787841954.571695:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841954.572059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841954.574692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841954.575083:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858634496 00000100:00100000:3.0:1787841954.575094:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858634496 00000100:00100000:3.0:1787841954.575157:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:3.0:1787841954.575168:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:10543:x1874687858634496:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787841954.576086:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787841954.576196:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787841954.576262:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.576279:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.576291:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.576300:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.576306:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.576311:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.576513:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858634240 00000100:00100000:2.0:1787841954.576521:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858634240 00000100:00100000:2.0:1787841954.576561:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 128 00000100:00100000:2.0:1787841954.576570:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10542:x1874687858634240:12345-192.168.202.46@tcp:58:lfs.0 00000040:00080000:2.0:1787841954.576750:0:8624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787841954.576986:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10542:x1874687858634240:12345-192.168.202.46@tcp:58:lfs.0 Request processed in 415us (4927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.576995:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 128 00010000:00010000:3.0:1787841954.580255:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841954.580322:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841954.581086:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.581099:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841954.581103:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.581132:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.581150:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9464999d2800) 00010000:00010000:3.0:1787841954.581153:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841954.581158:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.581164:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13679a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.581185:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841954.581187:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841954.581189:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841954.581364:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:10543:x1874687858634496:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 6193us (6678us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787841954.581374:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 32 00000020:00080000:3.0:1787841954.581381:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787841954.625307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841954.625551:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858634624 00000100:00100000:1.0:1787841954.625562:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858634624 00000100:00100000:1.0:1787841954.625621:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 129 00000100:00100000:1.0:1787841954.625631:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:10546:x1874687858634624:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841954.625656:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841954.625678:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e1367a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c1a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.625776:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.625792:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.625804:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.625818:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.625835:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.625843:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.626136:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.626146:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.626154:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.626188:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.626224:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 21 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.626241:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9955e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877521280:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841954.626332:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841954.629139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.629274:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858634880 00000100:00100000:2.0:1787841954.629283:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858634880 00000100:00100000:2.0:1787841954.629342:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:2.0:1787841954.629349:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:5586:x1874687858634880:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787841954.629559:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:5586:x1874687858634880:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 211us (429us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787841954.629565:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:1.0:1787841954.630161:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9955e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877521280:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841954.630188:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.631766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841954.631956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858635008 00000100:00100000:2.0:1787841954.631964:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858635008 00010000:00010000:2.0:1787841954.632028:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 23 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841954.632072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:2.0:1787841954.632079:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:2349:x1874687858635008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841954.632092:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841954.632097:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 23 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.632107:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 23 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.632124:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e1366c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97bdb expref: 23 pid: 5850 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.632137:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:2.0:1787841954.632140:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.632147:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.632152:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.632179:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841954.632326:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632340:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841954.632376:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787841954.632380:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841954.632394:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632404:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632411:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632415:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632427:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632431:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841954.632434:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632439:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632445:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841954.632447:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841954.632450:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632454:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e1367a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632505:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632509:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632513:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632515:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841954.632517:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632528:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632534:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94649317ae00) 00010000:00010000:1.0:1787841954.632535:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841954.632537:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632540:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1367af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632567:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e1367a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c1a expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632576:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c1a expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.632580:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841954.632582:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841954.632583:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246a00, rc 0) 00000100:00100000:2.0:1787841954.632695:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:2349:x1874687858635008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 615us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.632701:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:1.0:1787841954.633416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10546:x1874687858634624:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 7786us (8118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.633424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 129 00010000:00010000:1.0:1787841955.315702:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787841955.545987:0:12050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841955.545997:0:12050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841955.546051:0:12050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787841955.546061:0:12050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787841955.633869:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841955.633879:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841955.633935:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787841955.633944:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841955.634380:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9955e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877521408:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841955.634643:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841955.639069:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9955e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877521408:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787841955.639662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841955.640020:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858635136 00000100:00100000:3.0:1787841955.640029:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858635136 00000100:00100000:3.0:1787841955.640105:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 130 00000100:00100000:3.0:1787841955.640116:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10558:x1874687858635136:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787841955.640153:0:8624:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787841955.640294:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10558:x1874687858635136:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 179us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841955.640302:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 130 00000100:00080000:2.0:1787841955.640365:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841955.642565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841955.642625:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858635392 00000100:00100000:1.0:1787841955.642635:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858635392 00000100:00100000:1.0:1787841955.642695:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 131 00000100:00100000:1.0:1787841955.642707:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:10558:x1874687858635392:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841955.642729:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841955.642750:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1367bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c21 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.642877:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.642893:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.642906:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841955.642919:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787841955.643057:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1367bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c21 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.643074:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c21 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.643082:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841955.643091:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841955.643095:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246c00, rc 0) 00000100:00100000:1.0:1787841955.643148:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:10558:x1874687858635392:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 443us (591us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787841955.643155:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 131 00000100:00100000:0.0:1787841955.655317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841955.656436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858635520 00000100:00100000:3.0:1787841955.656449:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858635520 00000100:00100000:3.0:1787841955.656587:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:3.0:1787841955.656599:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c910b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:2348:x1874687858635520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841955.656616:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841955.656644:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c21 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841955.656664:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841955.656670:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841955.656734:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c910b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:2348:x1874687858635520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 138us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841955.657576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841955.658575:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858635776 00000100:00100000:1.0:1787841955.658588:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858635776 00000100:00100000:1.0:1787841955.658655:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 132 00000100:00100000:1.0:1787841955.658667:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9955e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:10558:x1874687858635776:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787841955.658920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00010000:00010000:1.0:1787841955.659405:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659424:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659437:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659699:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659708:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659716:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659723:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841955.659728:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659761:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659773:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841955.659776:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787841955.659781:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841955.659787:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e1367d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841955.659957:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9955e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:10558:x1874687858635776:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 1291us (2382us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787841955.659965:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 132 00000040:00080000:3.0:1787841955.686942:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841955.686953:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787841955.687007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841955.687118:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636032 00000100:00100000:0.0:1787841955.687128:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636032 00000100:00100000:0.0:1787841955.687183:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:0.0:1787841955.687195:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:10558:x1874687858636032:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787841955.688546:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:10558:x1874687858636032:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 1345us (1535us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787841955.688557:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 34 00000040:00080000:3.0:1787841955.689193:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787841955.689217:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787841956.085849:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877521664:0@lo:400:kworker.0 00000100:00100000:3.0:1787841956.085921:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877521536:0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.085930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841956.085985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841956.086004:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877522176:0@lo:400:kworker.0 00000100:00100000:3.0:1787841956.086018:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648cb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877522048:0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.086038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841956.086051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841956.086090:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877521920:0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.086092:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877521536 00000100:00100000:2.0:1787841956.086101:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877521536 00000100:00100000:3.0:1787841956.086136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841956.086151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787841956.086157:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841956.086164:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877521536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841956.086166:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877521792:0@lo:400:kworker.0 00000100:00100000:3.0:1787841956.086190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841956.086234:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877521664 00000100:00100000:3.0:1787841956.086238:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877521664 00000100:00100000:2.0:1787841956.086249:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877521536:12345-0@lo:400:kworker.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841956.086258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787841956.086266:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522048 00000100:00100000:3.0:1787841956.086270:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522048 00000100:00100000:3.0:1787841956.086299:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877521792 00000100:00100000:3.0:1787841956.086302:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877521792 00000100:00100000:2.0:1787841956.086303:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522176 00000100:00100000:1.0:1787841956.086307:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787841956.086308:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522176 00000100:00100000:1.0:1787841956.086317:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877521664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841956.086339:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787841956.086341:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877521920 00000100:00100000:2.0:1787841956.086346:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877521920 00000100:00100000:3.0:1787841956.086351:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.086370:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787841956.086377:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877521664:12345-0@lo:400:kworker.0 Request processed in 63us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841956.086378:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877522176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841956.086385:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787841956.086399:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877522048:12345-0@lo:400:kworker.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841956.086406:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787841956.086413:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877521792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841956.086474:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877521792:12345-0@lo:400:kworker.0 Request processed in 43us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841956.086479:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787841956.086515:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877522176:12345-0@lo:400:kworker.0 Request processed in 137us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841956.086521:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787841956.086540:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841956.086544:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841956.086547:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841956.086577:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877521536:0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.086590:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648cb2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877522048:0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.086646:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877521664:0@lo:400:kworker.0 00000100:00100000:2.0:1787841956.086667:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877522176:0@lo:400:kworker.0 00000100:00100000:0.0:1787841956.086735:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1874687877521920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841956.086777:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1874687877521920:12345-0@lo:400:kworker.0 Request processed in 290us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841956.086783:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787841956.086818:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877521792:0@lo:400:kworker.0 00000100:00100000:0.0:1787841956.086828:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877521920:0@lo:400:kworker.0 00000100:00100000:3.0:1787841956.090671:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787841956.098068:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:0.0:1787841956.338029:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841956.593889:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841956.593984:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841956.594679:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522304 00000100:00100000:0.0:1787841956.594687:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522304 00000100:00100000:0.0:1787841956.594738:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787841956.594754:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874687877522304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841956.594799:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841956.594873:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874687877522304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841956.594881:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787841956.595933:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841957.117929:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841957.117964:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877522432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841957.118050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841957.123204:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522432 00000100:00100000:3.0:1787841957.123221:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522432 00000100:00100000:3.0:1787841957.123282:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787841957.123293:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874687877522432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841957.123331:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841957.123430:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874687877522432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841957.123438:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787841957.123527:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877522432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841957.366563:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787841957.530647:0:12101:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841957.530665:0:12101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841957.530720:0:12101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787841957.530729:0:12101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841957.732619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841957.732717:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636288 00000100:00100000:0.0:1787841957.732728:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636288 00000100:00100000:0.0:1787841957.732803:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 133 00000100:00100000:0.0:1787841957.732814:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:10578:x1874687858636288:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841957.732840:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841957.732861:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1367d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c28 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841957.732962:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1367e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841957.732977:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1367e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841957.732988:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1367e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841957.732999:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787841957.733118:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1367d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c28 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841957.733134:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1367e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c28 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841957.733142:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:0.0:1787841957.733150:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787841957.733155:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480a00, rc 0) 00000100:00100000:0.0:1787841957.733227:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:10578:x1874687858636288:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 414us (617us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787841957.733235:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 133 00000100:00080000:1.0:1787841957.733631:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841957.743167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841957.747611:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636416 00000100:00100000:3.0:1787841957.747630:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636416 00000100:00100000:3.0:1787841957.747748:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 134 00000100:00100000:3.0:1787841957.747759:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:10578:x1874687858636416:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:3.0:1787841957.747824:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747841:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747852:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747876:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747883:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747890:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747896:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841957.747900:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747907:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747931:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:3.0:1787841957.747934:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841957.747938:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841957.747945:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1367ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841957.748021:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:10578:x1874687858636416:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 264us (4864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841957.748029:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 134 00000100:00100000:0.0:1787841957.854939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841957.855053:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636544 00000100:00100000:2.0:1787841957.855064:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636544 00000100:00100000:2.0:1787841957.855139:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:2.0:1787841957.855149:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858636544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1787841957.855170:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841957.855203:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066a0d359/0x1d0ed3605e1367f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c2f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841957.855232:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a904da1, atime: 0x6a904da1, ctime: 0x6a904da1, blocks: 0xb 00010000:00010000:2.0:1787841957.855256:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1787841957.855263:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841957.855272:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066a0d359/0x1d0ed3605e1367f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c2f expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841957.855290:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066a0d359/0x1d0ed3605e1367f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c2f expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841957.855304:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dee00, rc 0) 00000100:00100000:2.0:1787841957.855379:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858636544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 231us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841957.855403:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00080000:1.0:1787841957.855486:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841957.860951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841957.862291:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636672 00000100:00100000:1.0:1787841957.862304:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636672 00002000:00100000:1.0:1787841957.862438:0:6699:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff94648cb2e940 x1874687858636672/t0(0) o3->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:458/0 lens 488/0 e 0 to 0 dl 1787841968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787841957.862449:0:6699:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff94648cb2e940 with x1874687858636672 ext(0->4095) 00002000:00010000:1.0:1787841957.862471:0:6699:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94648cb2e940 00000100:00100000:1.0:1787841957.862506:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:0.0:1787841957.865655:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858636672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1787841957.865965:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858636672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 3449us (5026us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787841957.865979:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3 00002000:00100000:0.0:1787841957.865989:0:6699:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff94648cb2e940 x1874687858636672/t0(0) o3->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:458/0 lens 488/4536 e 0 to 0 dl 1787841968 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841957.865999:0:6699:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff94648cb2e940 with x1874687858636672 ext(0->4095) 00002000:00010000:0.0:1787841957.866005:0:6699:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94648cb2e940 00000001:00080000:1.0:1787841958.217717:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1787841958.385755:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841959.182765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841959.183569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841959.183606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841959.183629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841959.183651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841959.183702:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637184 00000100:00100000:0.0:1787841959.183714:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637184 00000100:00100000:0.0:1787841959.183788:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637056 00000100:00100000:0.0:1787841959.183792:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637056 00000100:00100000:0.0:1787841959.183817:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:0.0:1787841959.183827:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858637184:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841959.183915:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858637184:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 88us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841959.183922:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:0.0:1787841959.183940:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:0.0:1787841959.183947:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486737c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858637056:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841959.183990:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486737c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858637056:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 43us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841959.183996:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:1.0:1787841959.185637:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636928 00000100:00100000:1.0:1787841959.185648:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636928 00000100:00100000:1.0:1787841959.185705:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 155 00000100:00100000:1.0:1787841959.185715:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:2348:x1874687858636928:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841959.185783:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:2348:x1874687858636928:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 69us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841959.185790:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 155 00000100:00080000:1.0:1787841959.185813:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841959.185818:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841959.185820:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841959.186559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858636800 00000100:00100000:3.0:1787841959.186566:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858636800 00000100:00100000:3.0:1787841959.186599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 297 00000100:00100000:3.0:1787841959.186606:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858636800:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841959.186650:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858636800:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 44us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841959.186657:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 297 00000100:00100000:0.0:1787841959.186765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637312 00000100:00100000:0.0:1787841959.186770:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637312 00000100:00100000:0.0:1787841959.186809:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 156 00000100:00100000:0.0:1787841959.186816:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486736d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858637312:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841959.186864:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486736d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2348:x1874687858637312:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 49us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841959.186872:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 156 00000100:00080000:3.0:1787841959.191385:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841959.421308:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787841959.766269:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1787841959.766287:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787841959.802848:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787841959.802899:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946483623240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787841959.802904:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648507c100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9464836239c0 00000020:00080000:0.0:1787841959.802908:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648507c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464b98d9800 00000020:00080000:0.0:1787841959.802931:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787841959.803381:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787841959.803634:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:2.0:1787841959.807426:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841959.807437:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841959.807593:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787841959.807601:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787841960.437483:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841961.202304:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877522560:0@lo:400:kworker.0 00000100:00100000:3.0:1787841961.202383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841961.202544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522560 00000100:00100000:0.0:1787841961.202553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522560 00000100:00100000:0.0:1787841961.202604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787841961.202613:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.206221:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c912940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877522688:0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.206326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841961.206399:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522688 00000100:00100000:1.0:1787841961.206408:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522688 00000100:00100000:1.0:1787841961.206489:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787841961.206499:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877522688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.206576:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877522688:12345-0@lo:400:kworker.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841961.206583:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787841961.206634:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c912940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877522688:0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.207508:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841961.207523:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877522816:0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.207565:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841961.207606:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522816 00000100:00100000:2.0:1787841961.207611:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522816 00000100:00100000:2.0:1787841961.207661:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787841961.207670:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c912940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877522816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.207712:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c912940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877522816:12345-0@lo:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841961.207718:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787841961.207748:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841961.207786:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877522816:0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.207821:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877522944:0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.207848:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841961.207876:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877522944 00000100:00100000:2.0:1787841961.207880:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877522944 00000100:00100000:2.0:1787841961.207913:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787841961.207920:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877522944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.207970:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877522944:12345-0@lo:400:kworker.0 Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841961.207976:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787841961.207991:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841961.208008:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787841961.208013:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464b99561c0, transno 4294967310 00000004:00080000:2.0:1787841961.208021:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787841961.208035:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877522944:0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.210621:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877523200:0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.210693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841961.211081:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841961.211098:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877523072:0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.211130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841961.211185:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523072 00000100:00100000:1.0:1787841961.211194:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523072 00000100:00100000:1.0:1787841961.211355:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787841961.211368:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841961.211426:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877523072:12345-0@lo:400:kworker.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841961.211434:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787841961.211480:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841961.211514:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877523072:0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.211665:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523200 00000100:00100000:2.0:1787841961.211671:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523200 00000100:00100000:2.0:1787841961.211710:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787841961.211718:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877523200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841961.211788:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877523200:12345-0@lo:400:kworker.0 Request processed in 72us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841961.211794:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1787841961.212071:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841961.212201:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787841961.212207:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94648847f840, transno 4294967304 00000100:00100000:1.0:1787841961.212220:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf80d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877523200:0@lo:400:kworker.0 00000100:00100000:0.0:1787841961.213077:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877522560:12345-0@lo:400:kworker.0 Request processed in 10460us (10688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841961.213100:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787841961.216370:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648c911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877522560:0@lo:400:kworker.0 00010000:00010000:2.0:1787841961.458961:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841961.716972:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841961.716995:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841961.717065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841961.717167:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523328 00000100:00100000:1.0:1787841961.717179:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523328 00000100:00100000:1.0:1787841961.717241:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787841961.717251:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c911e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877523328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841961.717293:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841961.717344:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c911e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877523328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841961.717353:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787841961.717408:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648847f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841962.226100:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946486736580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877523456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841962.226220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841962.226476:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523456 00000100:00100000:2.0:1787841962.226486:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523456 00000100:00100000:2.0:1787841962.226539:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787841962.226557:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c911680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877523456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841962.226598:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841962.239740:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c911680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877523456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13175us (13510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841962.239754:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841962.244303:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946486736580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877523456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841962.481634:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841963.509874:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841963.932861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841963.933667:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637440 00000100:00100000:0.0:1787841963.933690:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637440 00000100:00100000:0.0:1787841963.933810:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 135 00000100:00100000:0.0:1787841963.933823:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10231:x1874687858637440:12345-192.168.202.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787841963.933943:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10231:x1874687858637440:12345-192.168.202.46@tcp:60:lhsmtool_posix.0 Request processed in 124us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841963.933951:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 135 00000100:00080000:1.0:1787841963.934340:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841963.942607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841963.942775:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637696 00000100:00100000:0.0:1787841963.942785:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637696 00000100:00100000:0.0:1787841963.942852:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:0.0:1787841963.942863:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:10231:x1874687858637696:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787841963.945153:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:10231:x1874687858637696:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 2279us (2544us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787841963.945171:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:3.0:1787841964.182045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841964.182185:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637824 00000100:00100000:1.0:1787841964.182196:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637824 00000100:00100000:1.0:1787841964.182285:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 136 00000100:00100000:1.0:1787841964.182297:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486734b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+5:11032:x1874687858637824:12345-192.168.202.46@tcp:101:lsof.0 00010000:00010000:1.0:1787841964.182322:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841964.182343:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c36 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841964.182414:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841964.182442:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841964.182531:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841964.182746:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787841964.182751:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841964.182868:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841964.182896:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e1367fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841964.182916:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841964.182925:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:1.0:1787841964.182928:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841964.182932:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246000, rc 0) 00000100:00100000:1.0:1787841964.183001:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486734b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:11032:x1874687858637824:12345-192.168.202.46@tcp:101:lsof.0 Request processed in 706us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841964.183009:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 136 00000100:00080000:2.0:1787841964.183282:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841964.302943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841964.302999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841964.303046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841964.303048:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858637952 00000100:00100000:2.0:1787841964.303063:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858637952 00000100:00100000:2.0:1787841964.303160:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 299 00000100:00100000:2.0:1787841964.303173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858637952:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841964.303217:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638208 00000100:00100000:0.0:1787841964.303223:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638208 00000100:00100000:2.0:1787841964.303264:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858637952:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.303274:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 299 00000100:00100000:0.0:1787841964.303289:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638080 00000100:00100000:0.0:1787841964.303294:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638080 00000100:00100000:2.0:1787841964.303315:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 88 00000100:00100000:2.0:1787841964.303327:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858638208:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841964.303329:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 89 00000100:00100000:0.0:1787841964.303344:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486735e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858638080:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841964.303364:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858638208:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 40us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.303372:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 88 00000100:00100000:0.0:1787841964.303386:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486735e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858638080:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841964.303395:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 89 00000100:00080000:2.0:1787841964.303398:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841964.303404:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787841964.530506:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787841964.836011:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787841964.836226:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787841964.836322:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787841964.836333:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787841965.555352:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841966.322233:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877523584:0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.322325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841966.322389:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877524096:0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.322417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841966.322450:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787841966.322494:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf8030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877523712:0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.322519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841966.322535:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877524224:0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.322559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841966.322589:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524096 00000100:00100000:3.0:1787841966.322598:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524096 00000100:00100000:3.0:1787841966.322652:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523712 00000100:00100000:3.0:1787841966.322655:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523712 00000100:00100000:3.0:1787841966.322679:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787841966.322688:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486736580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877524096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.323115:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486736580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877524096:12345-0@lo:400:kworker.0 Request processed in 426us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841966.323123:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787841966.323142:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787841966.323149:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877523712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.323181:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877523712:12345-0@lo:400:kworker.0 Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.323568:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf802940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877523968:0@lo:400:kworker.0 00000100:00100000:1.0:1787841966.323608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841966.323634:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841966.323642:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf8003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877523840:0@lo:400:kworker.0 00000100:00100000:1.0:1787841966.323666:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841966.323734:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523840 00000100:00100000:1.0:1787841966.323753:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523840 00000100:00100000:2.0:1787841966.323892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523584 00000100:00100000:2.0:1787841966.323897:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523584 00000100:00100000:2.0:1787841966.323935:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787841966.323943:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877523584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841966.323983:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877523584:12345-0@lo:400:kworker.0 Request processed in 42us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.323990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787841966.324024:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524224 00000100:00100000:2.0:1787841966.324027:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524224 00000100:00100000:2.0:1787841966.324058:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877523968 00000100:00100000:2.0:1787841966.324060:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877523968 00000100:00100000:2.0:1787841966.324083:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787841966.324089:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877524224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841966.324128:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787841966.324136:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877523968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841966.324140:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877524224:12345-0@lo:400:kworker.0 Request processed in 52us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.324147:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787841966.324179:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877523968:12345-0@lo:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.324186:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787841966.324201:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841966.324205:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841966.324208:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841966.324241:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf802940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877523968:0@lo:400:kworker.0 00000100:00100000:3.0:1787841966.324291:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787841966.324334:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf8030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877523712:0@lo:400:kworker.0 00000100:00100000:1.0:1787841966.324632:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787841966.324639:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877523840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841966.324680:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877523840:12345-0@lo:400:kworker.0 Request processed in 42us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.324687:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1787841966.324769:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841966.324791:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf8003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877523840:0@lo:400:kworker.0 00000100:00100000:2.0:1787841966.324859:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877524224:0@lo:400:kworker.0 00000100:00100000:2.0:1787841966.324874:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877523584:0@lo:400:kworker.0 00000100:00100000:2.0:1787841966.324889:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877524096:0@lo:400:kworker.0 00010000:00010000:3.0:1787841966.577690:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841966.833936:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841966.833973:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877524352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841966.834070:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841966.834913:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524352 00000100:00100000:1.0:1787841966.834925:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524352 00000100:00100000:1.0:1787841966.834991:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841966.835002:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877524352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841966.835052:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841966.835140:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877524352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.835148:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787841966.835306:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877524352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841967.346373:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841967.346400:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a742940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841967.346490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841967.346616:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524480 00000100:00100000:1.0:1787841967.346625:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524480 00000100:00100000:1.0:1787841967.346678:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841967.346689:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877524480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841967.346740:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841967.346807:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877524480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841967.346815:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787841967.347121:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a742940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877524480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841967.602622:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841968.412638:0:12303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:46:07 (1787841967) 00010000:00010000:0.0:1787841968.625881:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841969.010011:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841969.010022:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841969.010537:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787841969.010549:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841969.427779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841969.427828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841969.427959:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638720 00000100:00100000:2.0:1787841969.427969:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638720 00000100:00100000:2.0:1787841969.428051:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:2.0:1787841969.428063:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858638720:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841969.428147:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858638720:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.428155:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00080000:0.0:1787841969.428273:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841969.428636:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638464 00000100:00100000:3.0:1787841969.428642:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638464 00000100:00100000:3.0:1787841969.428754:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 163 00000100:00100000:3.0:1787841969.428764:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2347:x1874687858638464:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841969.428810:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2347:x1874687858638464:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 49us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841969.428816:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 163 00000100:00080000:0.0:1787841969.428863:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841969.433556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841969.433601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841969.433640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841969.433784:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638848 00000100:00100000:0.0:1787841969.433795:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638848 00000100:00100000:0.0:1787841969.433868:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 164 00000100:00100000:0.0:1787841969.433879:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2346:x1874687858638848:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841969.433955:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2346:x1874687858638848:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.433963:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 164 00000100:00100000:3.0:1787841969.434351:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638336 00000100:00100000:3.0:1787841969.434357:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638336 00000100:00100000:3.0:1787841969.434398:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 301 00000100:00100000:3.0:1787841969.434405:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858638336:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841969.434440:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858638336:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 36us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841969.434446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 301 00000100:00080000:2.0:1787841969.434569:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841969.434792:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858638592 00000100:00100000:1.0:1787841969.434797:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858638592 00000100:00100000:1.0:1787841969.434885:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 93 00000100:00100000:1.0:1787841969.434894:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858638592:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841969.434926:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858638592:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 34us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.434933:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 93 00000100:00080000:2.0:1787841969.434974:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787841969.653402:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841969.801173:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841969.801336:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858639104 00000100:00100000:1.0:1787841969.801346:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858639104 00000100:00100000:1.0:1787841969.801409:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 137 00000100:00100000:1.0:1787841969.801420:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:11297:x1874687858639104:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841969.801443:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841969.801503:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e13680a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.801584:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.801599:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.801611:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.801629:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.801635:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.801656:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.802506:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13681f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.802520:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13681f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.802527:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13681f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841969.802538:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787841969.803534:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803546:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803552:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803558:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841969.803563:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803570:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803586:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9464999d2500) 00010000:00010000:1.0:1787841969.803589:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841969.803605:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803610:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136811 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803623:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803629:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803634:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803638:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841969.803641:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803645:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803652:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94649317ae00) 00010000:00010000:1.0:1787841969.803654:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841969.803657:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.803662:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136818 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.805495:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e13680a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c3d expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.805534:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13681f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c3d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.805543:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:1.0:1787841969.805546:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841969.805549:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246200, rc 0) 00000100:00100000:1.0:1787841969.805686:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:11297:x1874687858639104:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 4260us (4516us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787841969.805696:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 137 00000100:00100000:2.0:1787841969.821267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841969.821605:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858639232 00000100:00100000:0.0:1787841969.821627:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858639232 00000100:00100000:0.0:1787841969.821700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:0.0:1787841969.821711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:2347:x1874687858639232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841969.821728:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841969.821756:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e13681f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c3d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841969.821776:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:0.0:1787841969.821781:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841969.821838:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2347:x1874687858639232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.821845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:0.0:1787841969.827055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841969.827165:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858639360 00000100:00100000:1.0:1787841969.827177:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858639360 00000100:00100000:1.0:1787841969.827250:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 138 00000100:00100000:1.0:1787841969.827262:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:11297:x1874687858639360:12345-192.168.202.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787841969.827386:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:11297:x1874687858639360:12345-192.168.202.46@tcp:59:lhsmtool_posix.0 Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.827393:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 138 00000001:00080000:2.0:1787841969.995117:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:3.0:1787841970.043362:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841970.043374:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841970.044092:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787841970.044105:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787841970.675266:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841971.450400:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877524608:0@lo:400:kworker.0 00000100:00100000:2.0:1787841971.450509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841971.450646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524608 00000100:00100000:1.0:1787841971.450654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524608 00000100:00100000:1.0:1787841971.450723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787841971.450732:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877524608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.451397:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877524864:0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.451436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841971.451496:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841971.451503:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877524992:0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.451528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841971.451562:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524864 00000100:00100000:0.0:1787841971.451566:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524864 00000100:00100000:0.0:1787841971.451611:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787841971.451619:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877524864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.451658:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877524864:12345-0@lo:400:kworker.0 Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841971.452106:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877524736:0@lo:400:kworker.0 00000100:00100000:3.0:1787841971.452140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841971.452173:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877525248:0@lo:400:kworker.0 00000100:00100000:3.0:1787841971.452198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841971.452219:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841971.452225:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b98b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877525120:0@lo:400:kworker.0 00000100:00100000:3.0:1787841971.452247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841971.452604:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787841971.452627:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524736 00000100:00100000:0.0:1787841971.452632:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524736 00000100:00100000:0.0:1787841971.452680:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877525120 00000100:00100000:0.0:1787841971.452684:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877525120 00000100:00100000:0.0:1787841971.452703:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787841971.452710:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877524736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.452762:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877524736:12345-0@lo:400:kworker.0 Request processed in 52us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841971.452768:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787841971.452780:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787841971.452786:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.452815:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877525120:12345-0@lo:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841971.452821:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787841971.452849:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877524992 00000100:00100000:0.0:1787841971.452853:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877524992 00000100:00100000:0.0:1787841971.452878:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877525248 00000100:00100000:0.0:1787841971.452881:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877525248 00000100:00100000:0.0:1787841971.452901:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787841971.452907:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877524992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.452937:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877524992:12345-0@lo:400:kworker.0 Request processed in 30us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841971.452943:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787841971.452953:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787841971.452959:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a7403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877525248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.452982:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a7403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877525248:12345-0@lo:400:kworker.0 Request processed in 23us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841971.452987:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787841971.453001:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841971.453009:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841971.453012:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841971.453046:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877524992:0@lo:400:kworker.0 00000100:00100000:0.0:1787841971.453071:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877524864:0@lo:400:kworker.0 00000100:00100000:3.0:1787841971.454253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877525120:0@lo:400:kworker.0 00000100:00100000:3.0:1787841971.454270:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877524736:0@lo:400:kworker.0 00000100:00100000:3.0:1787841971.454280:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b98bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877525248:0@lo:400:kworker.0 00000100:00100000:1.0:1787841971.457237:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877524608:12345-0@lo:400:kworker.0 Request processed in 6494us (6717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841971.457251:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787841971.457446:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf93cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877524608:0@lo:400:kworker.0 00010000:00010000:1.0:1787841971.697617:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841971.959497:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787841971.959524:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877525376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841971.959607:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841971.960657:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877525376 00000100:00100000:1.0:1787841971.960669:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877525376 00000100:00100000:1.0:1787841971.960747:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841971.960757:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877525376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841971.960796:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841971.960872:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877525376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841971.960879:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841971.960935:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877525376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841972.144340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.144413:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858639488 00000100:00100000:0.0:1787841972.144424:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858639488 00000100:00080000:2.0:1787841972.144501:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841972.144526:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 139 00000100:00100000:0.0:1787841972.144540:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:11340:x1874687858639488:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841972.144564:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841972.144589:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13682d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c44 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.144664:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.144682:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.144696:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.144710:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.144717:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.144735:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145030:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145039:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145057:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145063:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.145068:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145076:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145089:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:0.0:1787841972.145093:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.145098:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145105:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145117:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145123:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145135:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145140:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.145143:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145149:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145158:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94648391bf00) 00010000:00010000:0.0:1787841972.145160:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.145163:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145169:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e13683b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145204:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13682d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c44 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145215:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:0.0:1787841972.145217:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.145221:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13682d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c44 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.145230:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481a00, rc 0) 00000100:00100000:0.0:1787841972.145304:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:11340:x1874687858639488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 768us (976us total) trans 0 rc 301/301 00000100:00100000:0.0:1787841972.145321:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 139 00000100:00100000:2.0:1787841972.150209:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.150365:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858639744 00000100:00100000:0.0:1787841972.150379:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858639744 00000100:00100000:0.0:1787841972.150451:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 140 00000100:00100000:0.0:1787841972.150486:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:11340:x1874687858639744:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:0.0:1787841972.150544:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841972.150575:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1361ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a7d expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.150594:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:0.0:1787841972.150599:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841972.150947:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.150964:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 5 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.150975:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.151010:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 5 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.151026:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 5 pid: 5849 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841972.151310:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877525504:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841972.151481:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485137480 going to sleep for 11 seconds 00000100:00100000:1.0:1787841972.159878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.160327:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858639872 00000100:00100000:2.0:1787841972.160337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858639872 00010000:00010000:2.0:1787841972.160405:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 6 pid: 5849 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.160483:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:2.0:1787841972.160495:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5092011a-795a-4dd0-a452-2a019c42720c+6:2349:x1874687858639872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841972.160514:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841972.160522:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 6 pid: 5849 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.160539:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 6 pid: 5849 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.160568:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841972.160574:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.160585:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.160602:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.160624:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841972.160692:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5092011a-795a-4dd0-a452-2a019c42720c+6:2349:x1874687858639872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 198us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841972.160700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00080000:1.0:1787841972.162707:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841972.163913:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136803 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c36 expref: 5 pid: 5849 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841972.163941:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877525504:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841972.163964:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.163976:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.163983:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.164011:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.164032:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.164053:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841972.165336:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787841972.165354:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.165363:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.165372:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.165379:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841972.165383:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.165391:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.165407:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3300) 00010000:00010000:3.0:1787841972.165411:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841972.165415:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.165422:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136842 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841972.165483:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d263703 reply state 00000000915ce714 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841972.165493:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841972.165593:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:11340:x1874687858639744:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 15108us (15393us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787841972.165602:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 140 00010000:00010000:3.0:1787841972.174053:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.174071:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.174079:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.174085:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841972.174091:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.174099:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.174118:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9464999d2700) 00010000:00010000:3.0:1787841972.174121:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841972.174126:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.174132:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136849 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.256158:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.258960:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858640000 00000100:00100000:0.0:1787841972.258975:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858640000 00000100:00100000:0.0:1787841972.259054:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 141 00000100:00100000:0.0:1787841972.259067:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:11348:x1874687858640000:12345-192.168.202.46@tcp:101:lctl.0 00010000:00010000:0.0:1787841972.259096:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841972.259121:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c4b expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.259197:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136857 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.259215:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.259228:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841972.259325:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841972.259329:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841972.259370:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.259397:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c4b expref: 15 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.259412:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c4b expref: 14 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.259420:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:0.0:1787841972.259423:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841972.259426:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480400, rc 0) 00000100:00100000:0.0:1787841972.259534:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:11348:x1874687858640000:12345-192.168.202.46@tcp:101:lctl.0 Request processed in 470us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.259543:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 141 00000100:00100000:1.0:1787841972.341060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.341374:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858640128 00000100:00100000:0.0:1787841972.341389:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858640128 00000100:00100000:0.0:1787841972.341454:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 142 00000100:00100000:0.0:1787841972.341496:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:11354:x1874687858640128:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841972.341518:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841972.341541:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13685e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c52 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341634:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341666:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341678:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341694:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341701:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341708:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341849:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341859:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341866:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841972.341897:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787841972.341900:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841972.341927:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341938:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341953:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341959:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341965:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.341969:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341976:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.341989:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:0.0:1787841972.341992:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.341997:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342003:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342017:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342023:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342028:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342033:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.342053:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342060:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342068:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94648391bd00) 00010000:00010000:0.0:1787841972.342071:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.342073:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342080:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e13686c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342116:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e13685e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c52 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342132:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c52 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.342139:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841972.342141:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787841972.342143:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481200, rc 0) 00000100:00100000:0.0:1787841972.342229:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:11354:x1874687858640128:12345-192.168.202.46@tcp:101:bash.0 Request processed in 736us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.342237:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 142 00000100:00100000:0.0:1787841972.346920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841972.346977:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858640384 00000100:00100000:1.0:1787841972.346988:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858640384 00000100:00100000:1.0:1787841972.347067:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 143 00000100:00100000:1.0:1787841972.347080:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf802940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+15:11354:x1874687858640384:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841972.347109:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841972.347133:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13687a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c59 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.347434:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.347449:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.347499:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.347679:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.347690:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.347700:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841972.348908:0:8624:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787841972.349741:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349759:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349770:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349814:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349821:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349841:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349847:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841972.349852:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349860:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349875:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841972.349878:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841972.349883:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349889:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136881 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841972.349905:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021525324 reply state 00000000071bd1d5 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.349914:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841972.349954:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e13687a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 18 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349968:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 17 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.349982:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:2.0:1787841972.349984:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841972.349993:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dea00, rc 0) 00000100:00100000:2.0:1787841972.350086:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf802940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11354:x1874687858640384:12345-192.168.202.46@tcp:101:bash.0 Request processed in 3009us (3177us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787841972.350096:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 143 00010000:00010000:2.0:1787841972.353821:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.353842:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.353849:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.353856:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841972.353862:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.353870:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.353889:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946487ed3700) 00010000:00010000:2.0:1787841972.353892:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841972.353897:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.353904:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136888 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841972.356911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.356991:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858640512 00000100:00100000:2.0:1787841972.357003:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858640512 00000100:00100000:2.0:1787841972.357123:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:2.0:1787841972.357135:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2348:x1874687858640512:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787841972.357168:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841972.357189:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c60 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841972.357220:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841972.357240:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1787841972.357245:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841972.357266:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.357288:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.357304:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfe00, rc 0) 00000100:00100000:2.0:1787841972.357388:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858640512:12345-192.168.202.46@tcp:101:bash.0 Request processed in 255us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841972.357396:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00080000:1.0:1787841972.357485:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841972.361730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841972.361955:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858640640 00000100:00100000:1.0:1787841972.361965:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858640640 00000100:00100000:1.0:1787841972.362027:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:1.0:1787841972.362048:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:11354:x1874687858640640:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841972.362068:0:12012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841972.362090:0:12012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c67 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.362123:0:12012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.362155:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841972.362160:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841972.362167:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 7 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.362209:0:12012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.362222:0:12012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841972.362235:0:12012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12012:1874687877525632:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841972.362359:0:12012:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485137540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841972.366145:0:12012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12012:1874687877525632:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841972.366201:0:12012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 7 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.366229:0:12012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247000, rc 0) 00000100:00100000:1.0:1787841972.366306:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a742940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:11354:x1874687858640640:12345-192.168.202.46@tcp:101:bash.0 Request processed in 4269us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841972.366317:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:3.0:1787841972.367359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.368639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858640768 00000100:00100000:2.0:1787841972.368724:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858640768 00010000:00010000:2.0:1787841972.368900:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.368959:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:2.0:1787841972.368973:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf905e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858640768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841972.368995:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841972.369055:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.369072:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.369100:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13689d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c60 expref: 7 pid: 6693 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.369121:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841972.369126:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841972.369135:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 6 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.369146:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 6 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.369255:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 6 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.369270:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb2940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1874687877525760:192.168.202.46@tcp:105: 00000100:00100000:2.0:1787841972.369426:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841972.375294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.375416:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb2940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1874687877525760:192.168.202.46@tcp:105: 00000100:00100000:0.0:1787841972.375428:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858641024 00000100:00100000:0.0:1787841972.375437:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858641024 00010000:00010000:2.0:1787841972.375441:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841972.375529:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf905e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858640768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6558us (8176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.375536:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:0.0:1787841972.375547:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf906940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11354:x1874687858641024:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:2.0:1787841972.375554:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:0.0:1787841972.375862:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf906940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11354:x1874687858641024:12345-192.168.202.46@tcp:35:bash.0 Request processed in 317us (579us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787841972.375870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:3.0:1787841972.454207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841972.454378:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858641280 00000100:00100000:1.0:1787841972.454391:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858641280 00000100:00100000:1.0:1787841972.454501:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 144 00000100:00100000:1.0:1787841972.454530:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf9043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11364:x1874687858641280:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841972.454560:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841972.454586:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e1368ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c6e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841972.454880:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787841972.455022:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e1368ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c6e expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.455046:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:1.0:1787841972.455050:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841972.455055:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e1368ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c6e expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.455071:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247400, rc 0) 00000100:00100000:1.0:1787841972.455132:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf9043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11364:x1874687858641280:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 608us (937us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787841972.455139:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 144 00000100:00100000:3.0:1787841972.458077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.458181:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858641536 00000100:00100000:0.0:1787841972.458192:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858641536 00000100:00100000:0.0:1787841972.458249:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:0.0:1787841972.458258:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf907840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11364:x1874687858641536:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1787841972.458566:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf907840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11364:x1874687858641536:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 307us (498us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787841972.458574:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:2.0:1787841972.466773:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841972.466799:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf904780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877525888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841972.466870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841972.467634:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877525888 00000100:00100000:1.0:1787841972.467644:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877525888 00000100:00100000:1.0:1787841972.467702:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787841972.467712:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877525888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841972.467752:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841972.467827:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877525888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841972.467834:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787841972.467946:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf904780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877525888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841972.535914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.539493:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858641664 00000100:00100000:0.0:1787841972.539509:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858641664 00000100:00100000:0.0:1787841972.539604:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 145 00000100:00100000:0.0:1787841972.539616:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11370:x1874687858641664:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841972.539645:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841972.539681:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c75 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.539774:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1368c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.539791:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1368c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.539804:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1368c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841972.539891:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787841972.539895:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841972.539922:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1368c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.539954:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c75 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.539976:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1368c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c75 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.539985:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841972.539988:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841972.539991:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841972.541080:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11370:x1874687858641664:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1459us (5167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.541090:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 145 00000100:00100000:3.0:1787841972.546768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.546915:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858641920 00000100:00100000:0.0:1787841972.546926:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858641920 00000100:00100000:0.0:1787841972.546982:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 146 00000100:00100000:0.0:1787841972.546992:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf906580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11370:x1874687858641920:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841972.547013:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841972.547053:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c7c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.547167:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1368ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.547201:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1368ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.547213:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1368ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841972.547226:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787841972.547373:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c7c expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.547394:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1368ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c7c expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.547403:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:0.0:1787841972.547407:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841972.547411:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787841972.547526:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf906580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11370:x1874687858641920:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 536us (769us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787841972.547533:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 146 00000100:00100000:0.0:1787841972.555414:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.555551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841972.555642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858642048 00000100:00100000:1.0:1787841972.555680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858642048 00000100:00100000:1.0:1787841972.555759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:1.0:1787841972.555768:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:2349:x1874687858642048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841972.555781:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841972.555806:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1368ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c7c expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.555821:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:1.0:1787841972.555826:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841972.555887:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:2349:x1874687858642048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841972.555896:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:2.0:1787841972.558386:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858642304 00000100:00100000:2.0:1787841972.558584:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858642304 00000100:00100000:2.0:1787841972.559112:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 147 00000100:00100000:2.0:1787841972.559126:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11370:x1874687858642304:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841972.559165:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841972.559193:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1368dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c83 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.559313:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1368e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.559329:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1368e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.559340:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1368e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841972.559353:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787841972.559528:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e1368dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c83 expref: 25 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.559549:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1368e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c83 expref: 24 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.559576:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:2.0:1787841972.559579:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787841972.559583:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841972.559668:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:11370:x1874687858642304:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 545us (4273us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787841972.559676:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 147 00000100:00100000:0.0:1787841972.567261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.567350:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858642432 00000100:00100000:2.0:1787841972.567363:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858642432 00000100:00100000:2.0:1787841972.567432:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:2.0:1787841972.567452:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858642432:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1787841972.567541:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.567564:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 6 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.567573:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841972.567578:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841972.567583:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.567623:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 6 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.567638:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 6 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.567682:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874687877526016:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841972.567790:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66240 going to sleep for 11 seconds 00000100:00100000:2.0:1787841972.576990:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874687877526016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841972.577027:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841972.578801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.579016:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858642560 00000100:00100000:2.0:1787841972.579029:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858642560 00002000:00100000:2.0:1787841972.579098:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9464b98ba580 x1874687858642560/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:473/0 lens 504/0 e 0 to 0 dl 1787841983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841972.579110:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b98ba580 with x1874687858642560 ext(0->12) 00010000:00010000:2.0:1787841972.579119:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 7 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.579161:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 7 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841972.579170:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9464b98ba580 00000100:00100000:2.0:1787841972.579203:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:2.0:1787841972.579214:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858642560:12345-192.168.202.46@tcp:4:lfs.0 00000100:00100000:2.0:1787841972.579945:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2348:x1874687858642560:12345-192.168.202.46@tcp:4:lfs.0 Request processed in 730us (1155us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787841972.579952:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00002000:00100000:2.0:1787841972.579964:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9464b98ba580 x1874687858642560/t4294967305(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:473/0 lens 504/448 e 0 to 0 dl 1787841983 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841972.579970:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464b98ba580 with x1874687858642560 ext(0->12) 00010000:00010000:2.0:1787841972.579975:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 9 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.579984:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 9 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841972.579989:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9464b98ba580 00000100:00100000:3.0:1787841972.588274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.588385:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858642688 00000100:00100000:2.0:1787841972.588396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858642688 00010000:00010000:2.0:1787841972.588604:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 9 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.589302:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 62 00000100:00100000:2.0:1787841972.589319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2346:x1874687858642688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841972.589337:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787841972.589361:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787841972.589364:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787841973 00002000:00010000:2.0:1787841972.589367:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787841973 00002000:00010000:2.0:1787841972.589369:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787841973 00010000:00010000:2.0:1787841972.589378:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 9 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.589393:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 9 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.589435:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1be266/0x1d0ed3605e1368a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c67 expref: 9 pid: 12012 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.589488:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841972.589494:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841972.589499:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.589511:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.589553:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841972.589631:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2346:x1874687858642688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 318us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841972.589639:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 62 00010000:00010000:0.0:1787841972.589779:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589789:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589825:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589833:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589840:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589847:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841972.589851:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589860:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589872:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.589879:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015906291/0x1d0ed3605e1368f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841972.589930:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858642432:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 22481us (22681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.589937:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:3.0:1787841972.592704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.592864:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858642944 00000100:00100000:0.0:1787841972.592874:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858642944 00000100:00100000:0.0:1787841972.592924:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:0.0:1787841972.592934:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:11370:x1874687858642944:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:0.0:1787841972.593001:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1368e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c83 expref: 24 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841972.593296:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787841972.593344:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787841972.593893:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787841972.593953:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.593965:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 28 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.593972:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.594011:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 28 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.594021:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 28 pid: 8624 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841972.594035:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874687877526144:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841972.594125:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841972.598342:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874687877526144:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841972.598392:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841972.599785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841972.601027:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858643072 00000100:00100000:1.0:1787841972.601047:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858643072 00010000:00010000:1.0:1787841972.601095:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 29 pid: 8624 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841972.601126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:1.0:1787841972.601135:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:2349:x1874687858643072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841972.601161:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841972.601168:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 29 pid: 8624 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.601182:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 29 pid: 8624 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.601208:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e13688f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c59 expref: 29 pid: 8624 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.601243:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:1.0:1787841972.601249:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.601259:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.601266:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.601303:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841972.601378:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:2349:x1874687858643072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 243us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841972.601386:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 63 00010000:00010000:2.0:1787841972.603574:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.603588:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841972.603737:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787841972.603947:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787841972.604093:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877526272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787841972.604180:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841972.604218:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841972.605799:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877526272 00000100:00100000:1.0:1787841972.605812:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877526272 00000100:00100000:1.0:1787841972.605882:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841972.605891:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874687877526272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787841972.605995:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874687877526272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841972.606002:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787841972.606164:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877526272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787841972.606987:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787841972.607083:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877526400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787841972.607134:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841972.607342:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841972.607414:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877526400 00000100:00100000:1.0:1787841972.607421:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877526400 00000100:00100000:1.0:1787841972.607492:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841972.607502:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874687877526400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787841972.607670:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1874687877526400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 169us (534us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787841972.607689:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787841972.607968:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fcb0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874687877526400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787841972.608025:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787841972.608074:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.608084:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.608092:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.608098:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841972.608103:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.608113:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.608130:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:2.0:1787841972.608133:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787841972.608140:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841972.608146:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e1368f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841972.608334:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787841972.608557:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787841972.608569:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361583111763ns, next at 362583109727ns, rc = 0 00000001:00080000:2.0:1787841972.608577:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787841972.608612:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3f00) 00010000:00010000:2.0:1787841972.608615:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787841972.608621:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1368e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c83 expref: 32 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841972.608869:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:11370:x1874687858642944:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 15935us (16178us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787841972.608879:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 38 00000020:00080000:2.0:1787841972.608884:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787841972.611935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841972.611986:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858643200 00000100:00100000:1.0:1787841972.611996:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858643200 00000100:00100000:1.0:1787841972.612174:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 148 00000100:00100000:1.0:1787841972.612187:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf906940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:11370:x1874687858643200:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841972.612220:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841972.612248:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1368ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.612310:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1368ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c8a expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.612326:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1368ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c8a expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841972.612347:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:1.0:1787841972.612351:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841972.612355:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246000, rc 0) 00000100:00100000:1.0:1787841972.612432:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf906940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11370:x1874687858643200:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 248us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841972.612998:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 148 00000100:00100000:1.0:1787841972.617061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841972.617272:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858643456 00000100:00100000:3.0:1787841972.617282:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858643456 00000100:00100000:3.0:1787841972.617343:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:3.0:1787841972.617354:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11370:x1874687858643456:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841972.617778:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:11370:x1874687858643456:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 424us (727us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787841972.617786:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:2.0:1787841972.722855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841972.723028:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858643712 00000100:00100000:3.0:1787841972.723048:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858643712 00000100:00100000:3.0:1787841972.723114:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 149 00000100:00100000:3.0:1787841972.723124:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+33:11380:x1874687858643712:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1787841972.723149:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841972.723180:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c91 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841972.723317:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787841972.723615:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136906 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c91 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.723632:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:3.0:1787841972.723635:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841972.723641:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c91 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.723663:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:3.0:1787841972.723722:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11380:x1874687858643712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 600us (876us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787841972.723729:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 149 00010000:00010000:0.0:1787841972.726807:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841972.728152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841972.728239:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858643840 00000100:00100000:3.0:1787841972.728250:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858643840 00000100:00100000:3.0:1787841972.728311:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 150 00000100:00100000:3.0:1787841972.728322:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11380:x1874687858643840:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:3.0:1787841972.728419:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.728449:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.730748:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.730869:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.730898:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.730906:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731023:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731032:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731050:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841972.731100:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731114:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731120:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731126:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731132:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841972.731136:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731144:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731164:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841972.731167:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841972.731172:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731178:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731194:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731199:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731204:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731209:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841972.731211:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731216:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731223:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9464999d2700) 00010000:00010000:3.0:1787841972.731225:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841972.731228:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731234:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13691b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731260:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731267:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731273:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731278:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841972.731281:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731287:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731294:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841972.731297:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841972.731299:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841972.731304:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841972.731495:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11380:x1874687858643840:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 3170us (3346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841972.731506:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 150 00000100:00100000:1.0:1787841972.737306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841972.737402:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858644096 00000100:00100000:2.0:1787841972.737415:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858644096 00000100:00100000:2.0:1787841972.737990:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:2.0:1787841972.738005:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11380:x1874687858644096:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1787841972.738371:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:11380:x1874687858644096:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 369us (1074us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787841972.738380:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:2.0:1787841972.785021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.785184:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858644352 00000100:00100000:0.0:1787841972.785195:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858644352 00000100:00100000:0.0:1787841972.785262:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 151 00000100:00100000:0.0:1787841972.785273:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:11383:x1874687858644352:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841972.785300:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841972.785322:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c98 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785408:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785425:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785437:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785453:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785515:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785523:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785694:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785719:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785727:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841972.785737:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787841972.785857:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785865:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785872:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785878:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.785883:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785891:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785904:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841972.785907:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.785912:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785918:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785932:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785944:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785950:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785954:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.785957:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785963:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785971:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391bd00) 00010000:00010000:0.0:1787841972.785973:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841972.785976:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.785981:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.786026:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 38 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.786353:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 37 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.786361:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841972.786364:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841972.786373:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787841972.786606:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11383:x1874687858644352:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1334us (1599us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787841972.786614:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 151 00000100:00100000:1.0:1787841972.790990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841972.791102:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858644480 00000100:00100000:0.0:1787841972.791115:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858644480 00000100:00100000:0.0:1787841972.791275:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 152 00000100:00100000:0.0:1787841972.791287:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11383:x1874687858644480:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:0.0:1787841972.791367:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791385:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791397:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791426:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791433:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791440:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791446:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841972.791451:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791481:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791509:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841972.791512:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841972.791519:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841972.791525:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e13694c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841972.791664:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11383:x1874687858644480:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 379us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.791673:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 152 00000100:00100000:1.0:1787841972.794285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841972.794382:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858644736 00000100:00100000:3.0:1787841972.794392:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858644736 00000100:00100000:3.0:1787841972.794537:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:3.0:1787841972.794561:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11383:x1874687858644736:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841972.795054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:11383:x1874687858644736:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 493us (776us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787841972.795063:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:2.0:1787841973.167824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841973.168028:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858644992 00000100:00100000:3.0:1787841973.168050:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858644992 00000100:00100000:3.0:1787841973.168113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 153 00000100:00100000:3.0:1787841973.168133:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:11414:x1874687858644992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1787841973.168161:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841973.168184:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97c9f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.168289:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13695a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.168307:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13695a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.168320:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13695a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841973.168333:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787841973.168511:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c9f expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.168533:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13695a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c9f expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.168561:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841973.168564:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841973.168568:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498c00, rc 0) 00000100:00100000:3.0:1787841973.168632:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11414:x1874687858644992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 509us (820us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787841973.168639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 153 00000100:00100000:1.0:1787841973.176025:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841973.176572:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858645248 00000100:00100000:2.0:1787841973.176582:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858645248 00000100:00100000:1.0:1787841973.177045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841973.177138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858645376 00000100:00100000:0.0:1787841973.177143:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858645376 00000100:00100000:0.0:1787841973.177208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:0.0:1787841973.177217:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+41:2348:x1874687858645376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841973.177234:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841973.177260:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e13695a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c9f expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.177280:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841973.177285:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841973.177340:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:2348:x1874687858645376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841973.177348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:2.0:1787841973.177425:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:2.0:1787841973.177434:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fdde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:11414:x1874687858645248:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1787841973.177683:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fdde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11414:x1874687858645248:12345-192.168.202.46@tcp:35:cat.0 Request processed in 250us (1668us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787841973.177701:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:1.0:1787841973.255937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841973.256256:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858645632 00000100:00100000:3.0:1787841973.256267:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858645632 00000100:00100000:3.0:1787841973.256337:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 154 00000100:00100000:3.0:1787841973.256347:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11420:x1874687858645632:12345-192.168.202.46@tcp:101:dd.0 00010000:00010000:3.0:1787841973.256378:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841973.256381:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841973.256411:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e1368c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c75 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.256433:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841973.256438:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841973.256453:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136968 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ca6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.256607:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.256634:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 40 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.256668:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.256707:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 40 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.256723:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 40 pid: 8624 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841973.256739:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf907840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877526528:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841973.256860:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464b912a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841973.261585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841973.261797:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858645760 00000100:00100000:2.0:1787841973.261809:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858645760 00010000:00010000:2.0:1787841973.261862:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 41 pid: 8624 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841973.261909:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:2.0:1787841973.261920:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+41:2349:x1874687858645760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841973.261939:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841973.261949:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 41 pid: 8624 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841973.261965:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 41 pid: 8624 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841973.261991:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:2.0:1787841973.261996:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841973.262006:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841973.262013:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841973.262043:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841973.262096:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+41:2349:x1874687858645760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 178us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841973.262126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 64 00010000:00010000:3.0:1787841973.262332:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e13693e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c98 expref: 40 pid: 8624 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841973.262346:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf907840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877526528:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841973.262367:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.262376:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.262382:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841973.262401:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787841973.262589:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136968 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.262616:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.262636:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841973.262639:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787841973.262649:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499a00, rc 0) 00000100:00100000:3.0:1787841973.262682:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11420:x1874687858645632:12345-192.168.202.46@tcp:101:dd.0 Request processed in 6337us (6759us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787841973.262690:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 154 00000100:00100000:2.0:1787841973.266680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841973.266772:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858646016 00000100:00100000:3.0:1787841973.266783:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858646016 00000100:00100000:3.0:1787841973.266847:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 155 00000100:00100000:3.0:1787841973.266857:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11420:x1874687858646016:12345-192.168.202.46@tcp:36:dd.0 00010000:00010000:3.0:1787841973.267223:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.267242:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.267253:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841973.267309:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787841973.267336:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000645d2fef reply state 00000000d562b371 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841973.267346:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841973.267510:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:11420:x1874687858646016:12345-192.168.202.46@tcp:36:dd.0 Request processed in 654us (842us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787841973.267519:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 155 00000020:00080000:3.0:1787841973.267525:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841973.270810:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.270827:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.270835:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.270841:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841973.270845:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.270853:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.270870:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841973.270873:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841973.270879:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.270886:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e13697d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841973.575052:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787841973.575076:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1787841973.639187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841973.639327:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858646144 00000100:00100000:0.0:1787841973.639338:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858646144 00000100:00100000:0.0:1787841973.639432:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 156 00000100:00100000:0.0:1787841973.639445:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fdded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+42:11434:x1874687858646144:12345-192.168.202.46@tcp:101:stat.0 00010000:00010000:0.0:1787841973.639515:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841973.639540:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cad expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639616:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639631:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639645:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639661:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639669:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639675:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639786:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639797:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639805:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639845:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.639861:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 43 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841973.639874:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877526656:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841973.639971:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841973.647898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841973.647996:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858646400 00000100:00100000:2.0:1787841973.648006:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858646400 00000100:00100000:2.0:1787841973.648092:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:2.0:1787841973.648104:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:5587:x1874687858646400:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787841973.648506:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:5587:x1874687858646400:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 401us (616us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787841973.648514:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:0.0:1787841973.648727:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877526656:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841973.648751:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841973.652002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841973.659973:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858646528 00000100:00100000:1.0:1787841973.659989:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858646528 00010000:00010000:1.0:1787841973.660057:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 45 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841973.660107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 65 00000100:00100000:1.0:1787841973.660117:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:2348:x1874687858646528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841973.660135:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841973.660210:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 45 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841973.660225:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 45 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841973.660251:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e13696f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ca6 expref: 45 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841973.660270:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:1.0:1787841973.660276:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841973.660285:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841973.660308:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841973.660398:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841973.660498:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:2348:x1874687858646528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 382us (8507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841973.660507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 65 00010000:00010000:0.0:1787841973.670657:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670674:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841973.670731:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787841973.670736:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841973.670759:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670775:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670787:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670817:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670835:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670842:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841973.670846:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670854:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670869:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841973.670872:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841973.670877:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670884:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e13698b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670902:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670908:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670914:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670919:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841973.670927:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670934:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670941:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391b100) 00010000:00010000:0.0:1787841973.670943:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841973.670946:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670951:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.670990:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cad expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.671005:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cad expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.671013:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841973.671015:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841973.671017:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841973.671118:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fdded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:11434:x1874687858646144:12345-192.168.202.46@tcp:101:stat.0 Request processed in 31674us (31944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841973.671127:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 156 00010000:00010000:2.0:1787841973.746671:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841973.749337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841973.749609:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858646784 00000100:00100000:3.0:1787841973.749622:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858646784 00000100:00100000:3.0:1787841973.749710:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 157 00000100:00100000:3.0:1787841973.749723:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:11440:x1874687858646784:12345-192.168.202.46@tcp:36:truncate.0 00010000:00010000:3.0:1787841973.749824:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841973.749851:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cad expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.749872:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841973.749878:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841973.750117:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.750132:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.750143:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841973.750191:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787841973.750213:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfac6c0 reply state 00000000d634d8af transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841973.750223:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841973.750865:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:11440:x1874687858646784:12345-192.168.202.46@tcp:36:truncate.0 Request processed in 1141us (1534us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787841973.750876:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 157 00000020:00080000:3.0:1787841973.750882:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787841973.763115:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.763135:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.763159:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.763166:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841973.763171:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.763179:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.763196:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841973.763199:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841973.763204:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841973.763211:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841973.985453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841973.985798:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858646912 00000100:00100000:3.0:1787841973.985810:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858646912 00000100:00100000:3.0:1787841973.985874:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 158 00000100:00100000:3.0:1787841973.985885:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:11454:x1874687858646912:12345-192.168.202.46@tcp:101:stat.0 00010000:00010000:3.0:1787841973.985913:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841973.985952:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cb4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986044:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986060:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986072:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986087:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986094:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986101:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986335:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986447:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986488:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841973.986528:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787841973.986533:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841973.986554:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986574:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986582:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986589:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986597:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986603:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841973.986607:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986615:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986627:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841973.986631:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841973.986984:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.986994:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e1369ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987010:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987016:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987042:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987048:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841973.987051:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987058:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987067:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9464999d2700) 00010000:00010000:3.0:1787841973.987069:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841973.987073:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987078:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987130:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987146:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841973.987152:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841973.990229:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841973.990310:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498c00, rc 0) 00000100:00100000:3.0:1787841973.990416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:11454:x1874687858646912:12345-192.168.202.46@tcp:101:stat.0 Request processed in 4528us (4970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841973.990443:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 158 00000100:00100000:2.0:1787841974.123379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.123641:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858647168 00000100:00100000:3.0:1787841974.123654:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858647168 00000100:00100000:2.0:1787841974.123851:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 159 00000100:00100000:2.0:1787841974.123864:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+45:11464:x1874687858647168:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841974.123890:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841974.123915:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cbb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841974.124263:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787841974.124326:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787841974.124492:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cbb expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.124508:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:2.0:1787841974.124527:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841974.124534:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cbb expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.124551:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de400, rc 0) 00000100:00100000:2.0:1787841974.124629:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:11464:x1874687858647168:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 769us (1605us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787841974.124638:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 159 00000100:00100000:1.0:1787841974.136388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.137119:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858647424 00000100:00100000:3.0:1787841974.137146:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858647424 00000100:00100000:3.0:1787841974.137221:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:3.0:1787841974.137233:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+46:11464:x1874687858647424:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841974.137570:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:11464:x1874687858647424:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 339us (1198us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787841974.137578:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:3.0:1787841974.257323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.257508:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858647680 00000100:00100000:0.0:1787841974.257520:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858647680 00000100:00100000:0.0:1787841974.257585:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 160 00000100:00100000:0.0:1787841974.257595:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf907840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:11470:x1874687858647680:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841974.257623:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841974.257649:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1369d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.257779:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.257797:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.257823:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.257862:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.257876:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 48 pid: 5849 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841974.257890:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877526784:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841974.257989:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787841974.266624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841974.266766:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877526784:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841974.266802:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841974.267065:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858647808 00000100:00100000:2.0:1787841974.267073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858647808 00010000:00010000:2.0:1787841974.267125:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 49 pid: 5849 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841974.267172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 66 00000100:00100000:2.0:1787841974.267183:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485379e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:2348:x1874687858647808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841974.267201:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841974.267209:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 49 pid: 5849 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.267222:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 49 pid: 5849 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.267248:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e1369bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cb4 expref: 49 pid: 5849 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.267266:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:2.0:1787841974.267271:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.267294:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.267302:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.267334:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841974.267567:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.267575:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841974.267596:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787841974.267769:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e1369d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.267786:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.267793:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841974.267795:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787841974.267806:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480e00, rc 0) 00000100:00100000:0.0:1787841974.267847:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf907840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+49:11470:x1874687858647680:12345-192.168.202.46@tcp:101:bash.0 Request processed in 10253us (10534us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787841974.267855:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 160 00000100:00100000:2.0:1787841974.268169:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485379e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+48:2348:x1874687858647808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 985us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.268177:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 66 00000100:00100000:2.0:1787841974.275312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.275736:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858648064 00000100:00100000:3.0:1787841974.275753:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858648064 00000100:00100000:2.0:1787841974.275957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 161 00000100:00100000:2.0:1787841974.275971:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+48:11470:x1874687858648064:12345-192.168.202.46@tcp:36:bash.0 00010000:00010000:2.0:1787841974.276313:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.276332:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.276354:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841974.276410:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787841974.276434:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d3838a7 reply state 0000000011c1a980 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841974.276444:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841974.276570:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:11470:x1874687858648064:12345-192.168.202.46@tcp:36:bash.0 Request processed in 603us (1269us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787841974.276594:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 161 00000020:00080000:2.0:1787841974.276600:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787841974.284034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.284721:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858648192 00000100:00100000:3.0:1787841974.284731:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858648192 00000100:00100000:3.0:1787841974.284818:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 162 00000100:00100000:3.0:1787841974.284829:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:11470:x1874687858648192:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841974.284855:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841974.284878:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cc9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.284995:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.285011:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.285041:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.285048:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.285066:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.285097:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.285272:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841974.285290:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877526912:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841974.285555:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787841974.287759:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287777:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287784:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287790:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841974.287795:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287802:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287829:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841974.287833:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841974.287837:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287848:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.287854:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e1369e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841974.296975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.297117:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877526912:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841974.297160:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841974.297396:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858648320 00000100:00100000:2.0:1787841974.297405:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858648320 00010000:00010000:2.0:1787841974.297443:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841974.297527:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:2.0:1787841974.297537:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:2349:x1874687858648320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841974.297555:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841974.297563:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.297575:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.297601:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e1369d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc2 expref: 52 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.297617:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:2.0:1787841974.297622:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.297807:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.297818:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.297865:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841974.297979:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:2349:x1874687858648320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 442us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.297988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 67 00010000:00010000:3.0:1787841974.298815:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.298827:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841974.298883:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787841974.298902:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841974.298930:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.298966:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e1369ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc9 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.298984:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc9 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.298992:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841974.298994:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841974.298998:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499800, rc 0) 00000100:00100000:3.0:1787841974.299059:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:11470:x1874687858648192:12345-192.168.202.46@tcp:101:bash.0 Request processed in 14232us (15046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841974.299068:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 162 00000100:00100000:2.0:1787841974.305450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.305573:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858648576 00000100:00100000:3.0:1787841974.305584:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858648576 00000100:00100000:3.0:1787841974.305653:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:3.0:1787841974.305664:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:11470:x1874687858648576:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:3.0:1787841974.305933:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:11470:x1874687858648576:12345-192.168.202.46@tcp:35:bash.0 Request processed in 270us (492us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787841974.305940:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:0.0:1787841974.467942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841974.470526:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858648832 00000100:00100000:2.0:1787841974.470543:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858648832 00000100:00100000:2.0:1787841974.470623:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 163 00000100:00100000:2.0:1787841974.470633:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485378b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:11480:x1874687858648832:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841974.470658:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841974.470680:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1369fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cd0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841974.470809:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787841974.470924:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1369fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cd0 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.470939:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:2.0:1787841974.470942:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841974.470947:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e1369fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cd0 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.470964:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841974.471046:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485378b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11480:x1874687858648832:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 413us (3114us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787841974.471054:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 163 00000100:00100000:2.0:1787841974.481586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841974.481659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858648960 00000100:00100000:1.0:1787841974.481671:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858648960 00000100:00100000:1.0:1787841974.481740:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 164 00000100:00100000:1.0:1787841974.481751:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11480:x1874687858648960:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:1.0:1787841974.481847:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.481866:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.481877:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.481892:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.481913:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.481920:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482031:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482041:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482047:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841974.482086:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482098:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482104:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482110:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482116:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841974.482119:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482127:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482147:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:1.0:1787841974.482150:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841974.482155:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482162:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136a09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482174:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482180:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482186:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482190:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841974.482193:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482198:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482205:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94649317a300) 00010000:00010000:1.0:1787841974.482207:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841974.482210:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482215:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482238:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482245:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482250:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482254:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841974.482256:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482262:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482268:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:1.0:1787841974.482270:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841974.482273:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841974.482278:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136a17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841974.482356:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11480:x1874687858648960:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 606us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841974.482364:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 164 00000100:00100000:0.0:1787841974.484565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.484654:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858649216 00000100:00100000:3.0:1787841974.484665:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858649216 00000100:00100000:3.0:1787841974.484723:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:3.0:1787841974.484732:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11480:x1874687858649216:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841974.485136:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:11480:x1874687858649216:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 403us (737us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787841974.485159:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:0.0:1787841974.554444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.554518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.554545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.554576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841974.554691:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858649600 00000100:00100000:1.0:1787841974.554702:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858649600 00000100:00100000:3.0:1787841974.554732:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858649472 00000100:00100000:3.0:1787841974.554739:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858649472 00000100:00080000:0.0:1787841974.554821:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841974.554826:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841974.554871:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00100000:1.0:1787841974.554898:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858649600:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841974.554992:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858649600:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 97us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841974.555001:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00100000:1.0:1787841974.555031:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:1.0:1787841974.555038:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858649472:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841974.555064:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858649472:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841974.555069:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:2.0:1787841974.555303:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858649344 00000100:00100000:2.0:1787841974.555308:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858649344 00000100:00100000:2.0:1787841974.555347:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 303 00000100:00100000:2.0:1787841974.555354:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858649344:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841974.555386:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858649344:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 33us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.555393:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 303 00000100:00100000:2.0:1787841974.555423:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858649728 00000100:00100000:2.0:1787841974.555426:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858649728 00000100:00080000:2.0:1787841974.555443:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841974.555490:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 168 00000100:00100000:2.0:1787841974.555496:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485379a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858649728:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841974.555522:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485379a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858649728:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.555528:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 168 00000100:00100000:1.0:1787841974.581765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.581853:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858649984 00000100:00100000:0.0:1787841974.581863:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858649984 00000100:00100000:0.0:1787841974.581920:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 165 00000100:00100000:0.0:1787841974.581932:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+53:11483:x1874687858649984:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841974.581965:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841974.581990:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cd7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582083:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582099:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582124:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582140:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582155:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582162:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582318:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582327:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582335:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841974.582345:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787841974.582441:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582449:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582490:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582497:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841974.582502:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582509:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582521:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841974.582524:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841974.582529:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582545:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582561:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582589:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582595:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582602:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841974.582606:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582612:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582619:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391b100) 00010000:00010000:0.0:1787841974.582622:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841974.582624:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582630:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582675:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cd7 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582689:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cd7 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.582703:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841974.582706:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841974.582709:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480e00, rc 0) 00000100:00100000:0.0:1787841974.582782:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11483:x1874687858649984:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 851us (1029us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787841974.582790:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 165 00000100:00100000:1.0:1787841974.586819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841974.587030:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858650112 00000100:00100000:2.0:1787841974.587042:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858650112 00000100:00100000:2.0:1787841974.587117:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 166 00000100:00100000:2.0:1787841974.587129:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fdde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11483:x1874687858650112:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:2.0:1787841974.587219:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587237:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587250:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587295:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587301:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587307:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587313:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dea00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841974.587317:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587324:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587336:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:2.0:1787841974.587340:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841974.587344:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.587350:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dea00/0x1d0ed3605e136a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841974.587755:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fdde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11483:x1874687858650112:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 625us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.587763:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 166 00000100:00100000:1.0:1787841974.597523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.597716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858650240 00000100:00100000:0.0:1787841974.597727:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858650240 00000100:00100000:0.0:1787841974.597787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787841974.597798:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:2349:x1874687858650240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841974.597814:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841974.597840:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cd7 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.597860:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:0.0:1787841974.597865:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841974.597915:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:2349:x1874687858650240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841974.597923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:2.0:1787841974.611015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841974.611137:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858650496 00000100:00100000:1.0:1787841974.611157:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858650496 00000100:00100000:1.0:1787841974.611223:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:1.0:1787841974.611234:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:11483:x1874687858650496:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1787841974.611528:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11483:x1874687858650496:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 294us (524us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787841974.611537:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00010000:00010000:3.0:1787841974.769632:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841974.860748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.860853:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858650752 00000100:00100000:3.0:1787841974.860863:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858650752 00000100:00100000:3.0:1787841974.860928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 167 00000100:00100000:3.0:1787841974.860938:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11501:x1874687858650752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1787841974.860962:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841974.860984:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cde expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.861130:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136a4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.861149:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136a4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.861163:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136a4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841974.861174:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787841974.861323:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cde expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.861343:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136a4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cde expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.861352:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:3.0:1787841974.861369:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787841974.861374:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:3.0:1787841974.861446:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:11501:x1874687858650752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 509us (709us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787841974.861453:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 167 00000100:00100000:2.0:1787841974.932274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841974.932382:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858650880 00000100:00100000:0.0:1787841974.932392:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858650880 00000100:00100000:0.0:1787841974.932480:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 168 00000100:00100000:0.0:1787841974.932492:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:11502:x1874687858650880:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841974.932516:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841974.932536:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ce5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.932622:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.932650:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.932663:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841974.933257:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787841974.933262:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841974.933288:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.933318:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ce5 expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.933340:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ce5 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841974.933360:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841974.933363:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841974.933367:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481600, rc 0) 00000100:00100000:0.0:1787841974.933437:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:11502:x1874687858650880:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 947us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841974.933445:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 168 00000100:00100000:2.0:1787841974.942969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.944949:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858651264 00000100:00100000:3.0:1787841974.944964:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858651264 00000100:00100000:3.0:1787841974.945145:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:3.0:1787841974.945159:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:11502:x1874687858651264:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841974.945561:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11502:x1874687858651264:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 404us (2602us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787841974.945569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:1.0:1787841974.950362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841974.950528:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858651392 00000100:00100000:2.0:1787841974.950539:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858651392 00000100:00100000:2.0:1787841974.950620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:2.0:1787841974.951035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11502:x1874687858651392:12345-192.168.202.46@tcp:103:lfs.0 00010000:00010000:2.0:1787841974.951057:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787841974.951092:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e1369f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cc9 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.951275:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cde expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.951293:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1368ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c8a expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.951305:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317a400) 00010000:00010000:2.0:1787841974.951319:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841974.951434:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:11502:x1874687858651392:12345-192.168.202.46@tcp:103:lfs.0 Request processed in 804us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.951443:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:2.0:1787841974.954380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841974.954576:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858651520 00000100:00100000:3.0:1787841974.954589:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858651520 00000100:00100000:3.0:1787841974.954773:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 169 00000100:00100000:3.0:1787841974.954784:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9946580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:11502:x1874687858651520:12345-192.168.202.46@tcp:58:lfs.0 00010000:00010000:3.0:1787841974.954909:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.954926:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841974.954936:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841974.955209:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787841974.955307:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9946580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:11502:x1874687858651520:12345-192.168.202.46@tcp:58:lfs.0 Request processed in 524us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841974.955329:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 169 00000100:00100000:0.0:1787841974.994444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841974.995259:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858651648 00000100:00100000:2.0:1787841974.995270:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858651648 00000100:00100000:2.0:1787841974.995344:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 170 00000100:00100000:2.0:1787841974.995356:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485378780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:11504:x1874687858651648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841974.995376:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841974.995399:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cec expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995533:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995549:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995561:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995579:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995587:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995594:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995706:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995716:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995723:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841974.995765:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787841974.995770:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841974.995789:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995813:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995821:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995828:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995834:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995840:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841974.995845:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995852:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995865:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841974.995869:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841974.995874:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995880:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995897:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995903:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995916:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995920:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841974.995924:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995930:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995938:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946487ed3700) 00010000:00010000:2.0:1787841974.995941:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841974.995943:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995949:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995979:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 58 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995987:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 57 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841974.995993:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:2.0:1787841974.995994:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841974.995995:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df200, rc 0) 00000100:00100000:2.0:1787841974.996333:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485378780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:11504:x1874687858651648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 977us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.996352:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 170 00000001:00080000:0.0:1787841975.107661:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:0.0:1787841975.107729:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:0.0:1787841975.107755:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787841975.107784:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9464980583c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787841975.107790:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9464980e8900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946498058b40 00000020:00080000:0.0:1787841975.107794:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9464980e8f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94649fe7b400 00000001:00080000:0.0:1787841975.107829:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:3.0:1787841975.108074:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787841975.108275:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787841975.108763:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877527040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787841975.108853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841975.109127:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877527040 00000100:00100000:2.0:1787841975.109137:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877527040 00000100:00100000:2.0:1787841975.109205:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787841975.109215:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf905e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877527040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787841975.109242:0:12012:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787841975.109276:0:12012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a904db5, atime: 0x6a904db5, ctime: 0x6a904db5, blocks: 0xb 00010000:00010000:2.0:1787841975.109286:0:12012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.109303:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787841975.109307:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841975.109314:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.109330:0:12012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.109340:0:12012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.109348:0:12012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.109367:0:12012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787841975.110105:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf905e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877527040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 889us (1249us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787841975.110121:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787841975.110153:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841975.110160:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.110169:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfe00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841975.110173:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.110182:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.110198:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.110205:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136a8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.110223:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841975.110225:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841975.110227:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841975.110257:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787841975.110262:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787841975.110286:0:3306:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9464b99452c0 x1874687877527040/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787841991 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787841975.110298:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464b99452c0/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787841975.110311:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877527040:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787841975.110448:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787841975.154004:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841975.154029:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841975.154085:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787841975.154094:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841975.154255:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877527168:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841975.154377:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841975.171835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.171872:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858651776 00000100:00100000:3.0:1787841975.171881:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858651776 00000100:00100000:3.0:1787841975.171938:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 171 00000100:00100000:3.0:1787841975.171965:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858651776:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787841975.172003:0:5851:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787841975.172141:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858651776:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 193us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.172149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 171 00000100:00100000:3.0:1787841975.172203:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877527168:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841975.197668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.197807:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858651904 00000100:00100000:0.0:1787841975.197819:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858651904 00000100:00100000:0.0:1787841975.197888:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 172 00000100:00100000:0.0:1787841975.197901:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:11515:x1874687858651904:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787841975.197990:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198021:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198036:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198073:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198081:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198104:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198136:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198144:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198150:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841975.198197:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787841975.198203:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841975.198218:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198229:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198235:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198241:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198246:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.198250:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198257:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198276:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:0.0:1787841975.198279:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841975.198284:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198289:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136a95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198302:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198308:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198313:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198318:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.198320:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198325:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198332:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff94648391b100) 00010000:00010000:0.0:1787841975.198334:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841975.198336:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198341:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136a9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198365:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198371:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198375:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198380:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.198382:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198387:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198395:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:0.0:1787841975.198397:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841975.198400:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.198405:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841975.198518:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:11515:x1874687858651904:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 Request processed in 619us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841975.198527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 172 00000100:00100000:1.0:1787841975.201257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.201355:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858652160 00000100:00100000:3.0:1787841975.201364:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858652160 00000100:00100000:3.0:1787841975.201433:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:3.0:1787841975.201444:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+16:11515:x1874687858652160:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841975.201498:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841975.201520:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136aaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cf3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201630:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201658:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201669:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841975.201681:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787841975.201875:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201883:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201889:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201895:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841975.201900:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201908:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201920:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:3.0:1787841975.201923:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841975.201927:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201934:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201976:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136aaa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cf3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.201993:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:3.0:1787841975.201995:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841975.202000:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136aaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cf3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.202009:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498200, rc 0) 00000100:00100000:3.0:1787841975.202084:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858652160:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 642us (837us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787841975.202091:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:3.0:1787841975.205236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.205317:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858652288 00000100:00100000:0.0:1787841975.205339:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858652288 00000100:00100000:0.0:1787841975.205400:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 174 00000100:00100000:0.0:1787841975.205426:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858652288:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841975.205504:0:5850:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787841975.205601:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858652288:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 177us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841975.205609:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 174 00000100:00100000:1.0:1787841975.228649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.228808:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858652544 00000100:00100000:3.0:1787841975.228820:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858652544 00000100:00100000:3.0:1787841975.228906:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 175 00000100:00100000:3.0:1787841975.228918:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858652544:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841975.228943:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841975.228946:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841975.228988:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ce5 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.229019:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841975.229025:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841975.229043:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136abf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97cfa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841975.229910:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787841975.230213:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.230229:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.230242:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.230302:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136abf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cfa expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.230320:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cfa expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.230329:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9464999d2d00) 00010000:00010000:3.0:1787841975.230332:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841975.230335:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499800, rc 0) 00000100:00100000:3.0:1787841975.230410:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858652544:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 1494us (1773us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787841975.230498:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 175 00000100:00100000:1.0:1787841975.235299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.235396:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858652800 00000100:00100000:0.0:1787841975.235406:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858652800 00000100:00100000:0.0:1787841975.235480:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 176 00000100:00100000:0.0:1787841975.235490:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fdde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858652800:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841975.235549:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841975.235577:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cfa expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235597:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9464999d2d00) 00010000:00010000:0.0:1787841975.235619:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841975.235652:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235667:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235677:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235691:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235698:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235711:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.235991:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236000:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236006:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236021:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.236026:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236033:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236042:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841975.236045:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841975.236049:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236056:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136ad4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236066:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236073:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236086:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236091:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.236094:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236100:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236108:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xad801b90 (ffff94648391b100) 00010000:00010000:0.0:1787841975.236110:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841975.236113:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.236118:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136adb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xad801b90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841975.236220:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fdde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858652800:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 731us (931us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841975.236229:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 176 00000100:00100000:0.0:1787841975.247788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841975.247877:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858652928 00000100:00100000:2.0:1787841975.247888:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858652928 00000100:00100000:2.0:1787841975.247947:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 177 00000100:00100000:2.0:1787841975.247972:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464853783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858652928:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841975.247995:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841975.248027:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d01 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.248066:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.248080:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.248092:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.248186:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.248205:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.248214:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:2.0:1787841975.248217:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841975.248221:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841975.248273:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464853783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858652928:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 304us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.248288:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 177 00000100:00100000:1.0:1787841975.257510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.257699:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858653184 00000100:00100000:3.0:1787841975.257711:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858653184 00000100:00100000:3.0:1787841975.257778:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 178 00000100:00100000:3.0:1787841975.257800:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858653184:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841975.257883:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.257901:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.257928:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841975.258253:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787841975.258263:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364232805688ns, next at 365232803296ns, rc = 0 00000004:00010000:3.0:1787841975.258352:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d91091a8 reply state 000000004c10f090 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841975.258362:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841975.258495:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11515:x1874687858653184:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 708us (997us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787841975.258504:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 178 00000100:00100000:1.0:1787841975.261405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1787841975.261490:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.261503:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.261511:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.261535:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.261540:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.261548:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.261563:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:0.0:1787841975.261566:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787841975.261571:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.261577:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136af0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841975.261734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858653312 00000100:00100000:3.0:1787841975.261744:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858653312 00000100:00100000:3.0:1787841975.262113:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 179 00000100:00100000:3.0:1787841975.262125:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11515:x1874687858653312:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841975.262155:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841975.262172:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d08 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.262235:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.262248:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.262265:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:3.0:1787841975.262275:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841975.262278:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481498c00, rc 0) 00000100:00100000:3.0:1787841975.262337:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11515:x1874687858653312:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 214us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.262343:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 179 00000100:00100000:1.0:1787841975.271888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841975.277768:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858653440 00000100:00100000:2.0:1787841975.277803:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858653440 00000100:00100000:2.0:1787841975.277882:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:2.0:1787841975.277894:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fdde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2348:x1874687858653440:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787841975.278287:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fdde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858653440:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 395us (6410us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787841975.278295:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:1.0:1787841975.280989:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.281071:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858653696 00000100:00100000:3.0:1787841975.281084:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858653696 00000100:00100000:3.0:1787841975.281144:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:3.0:1787841975.281154:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11515:x1874687858653696:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787841975.282155:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11515:x1874687858653696:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 998us (1175us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787841975.282165:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:1.0:1787841975.295123:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841975.298102:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858653952 00000100:00100000:2.0:1787841975.298115:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858653952 00000100:00100000:2.0:1787841975.298196:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 180 00000100:00100000:2.0:1787841975.298206:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11515:x1874687858653952:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787841975.298327:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11515:x1874687858653952:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 123us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.298335:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 180 00000100:00100000:1.0:1787841975.304856:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.305098:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654080 00000100:00100000:3.0:1787841975.305109:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654080 00000100:00100000:3.0:1787841975.305165:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 181 00000100:00100000:3.0:1787841975.305175:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11515:x1874687858654080:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841975.305194:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841975.305213:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d0f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.305276:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.305289:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.305301:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841975.305348:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841975.305364:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.305386:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d0f expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.305404:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d0f expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.305412:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:3.0:1787841975.305416:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787841975.305419:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946481499800, rc 0) 00000100:00100000:3.0:1787841975.305494:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11515:x1874687858654080:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 321us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.305501:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 181 00000100:00100000:1.0:1787841975.316100:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841975.316204:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654208 00000100:00100000:2.0:1787841975.316215:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654208 00000100:00100000:2.0:1787841975.316280:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:2.0:1787841975.316291:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858654208:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841975.316312:0:12012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841975.316334:0:12012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d16 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841975.316360:0:12012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904db8, blocks: 0x1 00010000:00010000:2.0:1787841975.316381:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787841975.316394:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841975.316404:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 8 pid: 12012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.316425:0:12012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 8 pid: 12012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.316440:0:12012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfe00, rc 0) 00000100:00100000:2.0:1787841975.316521:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858654208:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 232us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.316528:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:2.0:1787841975.332102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.334654:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654464 00000100:00100000:0.0:1787841975.334669:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654464 00000100:00100000:0.0:1787841975.338264:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 182 00000100:00100000:0.0:1787841975.338290:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11515:x1874687858654464:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787841975.338414:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11515:x1874687858654464:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 136us (6323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841975.338421:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 182 00000100:00100000:1.0:1787841975.346913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.347083:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654592 00000100:00100000:0.0:1787841975.347098:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654592 00000100:00100000:0.0:1787841975.347176:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:0.0:1787841975.347187:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:11515:x1874687858654592:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841975.347209:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841975.347251:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d1d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.347292:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.347303:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841975.347308:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841975.347314:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.347352:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.347367:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841975.347382:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877527296:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841975.347499:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841975.356418:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877527296:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841975.356887:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.356914:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:3.0:1787841975.357045:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:11515:x1874687858654592:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 9858us (10143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.357055:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:0.0:1787841975.365190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.365318:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654720 00000100:00100000:3.0:1787841975.365329:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654720 00010000:00010000:3.0:1787841975.365384:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841975.365425:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 68 00000100:00100000:3.0:1787841975.365435:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464853792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858654720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841975.365450:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841975.365509:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.365523:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.365547:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e136b0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d16 expref: 9 pid: 12012 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.365565:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841975.365569:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841975.365577:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.365588:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.365842:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841975.365871:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1874687877527424:192.168.202.46@tcp:105: 00000100:00100000:3.0:1787841975.365958:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787841975.369692:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1874687877527424:192.168.202.46@tcp:105: 00010000:00010000:3.0:1787841975.369725:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841975.369799:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464853792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858654720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4364us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.369810:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 68 00000100:00100000:1.0:1787841975.371003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.371090:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654848 00000100:00100000:3.0:1787841975.371098:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654848 00002000:00100000:3.0:1787841975.371157:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff946381cbb840 x1874687858654848/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:476/0 lens 504/0 e 0 to 0 dl 1787841986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841975.371168:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff946381cbb840 with x1874687858654848 ext(0->8) 00002000:00010000:3.0:1787841975.371174:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946381cbb840 00000100:00100000:3.0:1787841975.371206:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:3.0:1787841975.371216:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858654848:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787841975.371997:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2349:x1874687858654848:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 Request processed in 779us (996us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787841975.372006:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00002000:00100000:3.0:1787841975.372023:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff946381cbb840 x1874687858654848/t4294967314(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:476/0 lens 504/448 e 0 to 0 dl 1787841986 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841975.372032:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff946381cbb840 with x1874687858654848 ext(0->8) 00002000:00010000:3.0:1787841975.372036:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946381cbb840 00000100:00100000:0.0:1787841975.379365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.379453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858654976 00000100:00100000:3.0:1787841975.379538:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858654976 00000100:00100000:2.0:1787841975.379849:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 183 00000100:00100000:2.0:1787841975.379863:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11515:x1874687858654976:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787841975.423026:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1787841975.423053:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787841975.423086:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1787841975.423952:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858654976:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 Request processed in 44081us (44590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.423965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 183 00000100:00100000:1.0:1787841975.427021:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841975.427043:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877527552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787841975.427103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841975.427144:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877527552 00000100:00100000:1.0:1787841975.427151:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877527552 00000100:00100000:1.0:1787841975.427209:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787841975.427218:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877527552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787841975.427394:0:12012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787841975.427397:0:12012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787841976 00002000:00010000:1.0:1787841975.427400:0:12012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787841975.427402:0:12012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787841976 -> 1787841976 00002000:00010000:1.0:1787841975.427404:0:12012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787841975.427447:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877527552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (343us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787841975.427454:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787841975.427521:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946381cb9a40/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787841975.427528:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877527552:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787841975.427876:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787841975.427891:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:3.0:1787841975.427901:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841975.428072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.428370:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858655104 00000100:00100000:3.0:1787841975.428377:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858655104 00000100:00100000:3.0:1787841975.428424:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:3.0:1787841975.428433:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2348:x1874687858655104:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787841975.515898:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1787841975.515922:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1787841975.515927:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1787841975.516498:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858655104:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 Request processed in 88058us (88420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.516511:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:0.0:1787841975.523727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.525437:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858655360 00000100:00100000:0.0:1787841975.525495:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858655360 00000100:00100000:0.0:1787841975.525571:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 184 00000100:00100000:0.0:1787841975.525583:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485378f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858655360:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841975.525672:0:8624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841975.525704:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499800/0x1d0ed3605e136b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d0f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.525722:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:0.0:1787841975.525728:0:8624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841975.525765:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.525779:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.525790:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841975.526114:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9e7be83 reply state 00000000f2303b5e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841975.526136:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841975.526257:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485378f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11515:x1874687858655360:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 677us (2540us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787841975.526265:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 184 00000100:00100000:1.0:1787841975.533537:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1787841975.533592:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.534058:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.534067:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.534073:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841975.534079:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.534087:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.534105:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841975.534108:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841975.534113:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.534119:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841975.534180:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858655488 00000100:00100000:1.0:1787841975.534189:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858655488 00000100:00100000:1.0:1787841975.534241:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 56 00000100:00100000:1.0:1787841975.534250:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858655488:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787841975.534532:0:12012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787841975.534536:0:12012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787841976 -> 1787841975 00002000:00010000:1.0:1787841975.534538:0:12012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787841973 00002000:00010000:1.0:1787841975.534551:0:12012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787841976 -> 1787841975 00002000:00010000:1.0:1787841975.534554:0:12012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787841975.534736:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2347:x1874687858655488:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 484us (1208us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787841975.534745:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 56 00000100:00100000:0.0:1787841975.540213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.542070:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858655744 00000100:00100000:3.0:1787841975.542084:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858655744 00000100:00100000:3.0:1787841975.542167:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 185 00000100:00100000:3.0:1787841975.542178:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485379680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11515:x1874687858655744:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787841975.542245:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.542261:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.542271:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.542305:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.542319:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 18 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841975.542341:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877527680:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841975.542431:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485137540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841975.551429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.551533:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b7ac0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877527680:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841975.551568:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841975.552387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858655872 00000100:00100000:2.0:1787841975.552396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858655872 00010000:00010000:2.0:1787841975.552439:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841975.553431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:2.0:1787841975.553445:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:2348:x1874687858655872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841975.553489:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841975.553499:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.553515:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.553537:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d01 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.553553:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:2.0:1787841975.553558:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.553567:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.553575:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.554712:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841975.554782:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2348:x1874687858655872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1338us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.554792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 69 00010000:00010000:1.0:1787841975.554917:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.554927:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.554957:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.554963:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.554970:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.554975:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841975.554980:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.554987:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.555000:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841975.555003:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787841975.555007:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.555038:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498200/0x1d0ed3605e136b21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841975.555079:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485379680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858655744:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 Request processed in 12904us (14875us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787841975.555087:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 185 00000100:00100000:1.0:1787841975.563263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.565806:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858656000 00000100:00100000:0.0:1787841975.565822:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858656000 00000100:00100000:0.0:1787841975.565951:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:0.0:1787841975.565963:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858656000:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787841975.566025:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.566046:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.566055:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841975.566060:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841975.566064:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.566107:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.566132:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841975.566147:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877527808:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841975.566235:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464860139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841975.572267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841975.572514:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858656128 00000100:00100000:3.0:1787841975.572526:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858656128 00010000:00010000:3.0:1787841975.572574:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 9 pid: 6691 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841975.572740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00100000:3.0:1787841975.572825:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9946940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2348:x1874687858656128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841975.572845:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841975.572870:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 9 pid: 6691 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.572885:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 9 pid: 6691 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.572917:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841975.572922:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841975.572929:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.572940:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841975.572980:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841975.573055:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9946940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2348:x1874687858656128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 304us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.573063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 70 00010000:00010000:2.0:1787841975.577438:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136b13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d1d expref: 8 pid: 6691 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841975.577542:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877527808:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841975.577582:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577594:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577717:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577757:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577766:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577776:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577783:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841975.577787:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577796:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577816:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.577829:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136b28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841975.577956:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858656000:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 Request processed in 11995us (14704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.577965:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:3.0:1787841975.586040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841975.586731:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858656384 00000100:00100000:1.0:1787841975.586744:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858656384 00000100:00100000:1.0:1787841975.586801:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 186 00000100:00100000:1.0:1787841975.586811:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+17:11515:x1874687858656384:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787841975.586898:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.586918:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.586933:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.587201:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.587212:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.587221:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.587266:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.587279:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 18 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841975.587294:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877527936:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841975.590180:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649319c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841975.595005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841975.595052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858656512 00000100:00100000:2.0:1787841975.595060:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858656512 00010000:00010000:2.0:1787841975.595103:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841975.595154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00100000:2.0:1787841975.595165:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9944f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:2348:x1874687858656512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841975.595180:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841975.595187:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.595202:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 19 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.595227:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:2.0:1787841975.595232:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.595243:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.595266:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.595287:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841975.595342:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9944f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:2348:x1874687858656512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 179us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841975.595349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 71 00010000:00010000:1.0:1787841975.602110:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481498c00/0x1d0ed3605e136af7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d08 expref: 18 pid: 5851 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841975.604327:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877527936:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841975.604359:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.604372:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.604379:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841975.604599:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787841975.605287:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787841975.605339:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787841975.605446:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8624:1874687877528064:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787841975.605545:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841975.605581:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841975.606038:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877528064 00000100:00100000:1.0:1787841975.606046:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877528064 00000100:00100000:1.0:1787841975.606107:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841975.606117:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8624:x1874687877528064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787841975.606231:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8624:x1874687877528064:12345-0@lo:1000:mdt00_003.0 Request processed in 115us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841975.606239:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841975.606279:0:8624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787841975.606284:0:8624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946381cb9a40, transno 4294967315 00000100:00100000:1.0:1787841975.606296:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8624:1874687877528064:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787841975.606952:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787841975.607030:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8624:1874687877528192:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787841975.607074:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841975.607099:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649319cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841975.607448:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877528192 00000100:00100000:1.0:1787841975.607470:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877528192 00000100:00100000:1.0:1787841975.607499:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841975.607508:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8624:x1874687877528192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787841975.607790:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8624:x1874687877528192:12345-0@lo:1000:mdt00_003.0 Request processed in 282us (714us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787841975.607797:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841975.607839:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8624:1874687877528192:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787841975.607872:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607883:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607901:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607907:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841975.607911:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607920:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607937:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946487ed3700) 00010000:00010000:1.0:1787841975.607940:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841975.607945:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607951:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607980:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607986:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607991:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.607995:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841975.607998:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608026:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608035:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:1.0:1787841975.608038:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841975.608041:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608047:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946481499a00/0x1d0ed3605e136a6b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608069:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608082:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 21 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608091:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608117:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 21 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.608203:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 21 pid: 8624 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841975.608215:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cb9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877528320:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841975.608282:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649333df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841975.625410:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cb9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877528320:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841975.625444:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841975.625554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.627748:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858656640 00000100:00100000:0.0:1787841975.627758:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858656640 00010000:00010000:0.0:1787841975.627804:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 22 pid: 8624 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841975.627839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:0.0:1787841975.627848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9945680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:2348:x1874687858656640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841975.627863:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841975.627870:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 22 pid: 8624 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.627885:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 22 pid: 8624 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.627905:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136a87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97cec expref: 22 pid: 8624 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.627922:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:0.0:1787841975.627926:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.627935:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.627942:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.627967:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841975.628046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9945680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:2348:x1874687858656640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 197us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841975.628054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 72 00010000:00010000:0.0:1787841975.628082:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628090:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628103:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628109:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628115:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628121:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.628310:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628319:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628329:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:0.0:1787841975.628331:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841975.628334:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628340:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e136b3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628374:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628380:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628386:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628391:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841975.628394:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628400:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628408:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9464999d2700) 00010000:00010000:0.0:1787841975.628410:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841975.628413:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841975.628419:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e136b2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841975.629447:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841975.629473:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841975.632897:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787841975.632915:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841975.633071:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11515:x1874687858656384:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 46255us (47036us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787841975.633097:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 186 00000020:00080000:0.0:1787841975.633105:0:8624:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787841975.645283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841975.645390:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858656896 00000100:00100000:0.0:1787841975.645400:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858656896 00000100:00100000:0.0:1787841975.645479:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 50 00000100:00100000:0.0:1787841975.645490:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11515:x1874687858656896:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787841975.646977:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787841975.647105:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787841975.650793:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.650821:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.650834:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.650844:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.650851:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.650857:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841975.650875:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787841975.650987:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11515:x1874687858656896:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 5494us (5709us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787841975.650997:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 50 00000020:00080000:1.0:1787841975.651002:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787841975.653237:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841975.653253:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.653265:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787841975.653269:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.653279:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.653295:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94649317a300) 00010000:00010000:2.0:1787841975.653299:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787841975.653303:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.653310:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136b44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841975.653329:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841975.653331:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841975.653339:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841975.798603:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841975.996719:0:12454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841975.996730:0:12454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841975.996763:0:12454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787841975.996769:0:12454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841976.211296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.215320:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858657152 00000100:00100000:2.0:1787841976.215334:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858657152 00000100:00100000:2.0:1787841976.215423:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 187 00000100:00100000:2.0:1787841976.215434:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:11525:x1874687858657152:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841976.215475:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841976.215497:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.215769:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136b52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.215786:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.215800:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841976.215813:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787841976.215991:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d24 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.216021:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d24 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.216031:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841976.216034:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841976.216038:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de200, rc 0) 00000100:00100000:2.0:1787841976.216104:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:11525:x1874687858657152:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 673us (4815us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787841976.216196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 187 00000100:00080000:0.0:1787841976.219259:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841976.227147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.227227:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858657280 00000100:00100000:0.0:1787841976.227238:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858657280 00000100:00100000:0.0:1787841976.227293:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 188 00000100:00100000:0.0:1787841976.227305:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:11525:x1874687858657280:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:0.0:1787841976.227380:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227398:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227410:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227425:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227444:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227451:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227782:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227791:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227799:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841976.227837:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227851:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227857:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227864:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227869:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.227873:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227881:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227899:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841976.227902:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.227907:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227913:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136b60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227925:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227931:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227935:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227940:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.227943:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227948:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227954:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391bd00) 00010000:00010000:0.0:1787841976.227956:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.227959:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227964:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227987:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.227994:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.228000:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.228017:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.228020:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.228026:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.228034:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648391b700) 00010000:00010000:0.0:1787841976.228036:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.228038:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.228044:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.228126:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:11525:x1874687858657280:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 821us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.228134:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 188 00000100:00100000:1.0:1787841976.284978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.288781:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858657536 00000100:00100000:2.0:1787841976.288801:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858657536 00000100:00100000:2.0:1787841976.288862:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 189 00000100:00100000:2.0:1787841976.288872:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+24:11528:x1874687858657536:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841976.288891:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841976.288909:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136b75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d2b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.288977:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.288991:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289030:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289046:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289053:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289060:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289334:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289352:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289359:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841976.289368:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787841976.289445:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289453:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289482:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289488:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841976.289492:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289501:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289511:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841976.289514:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841976.289519:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289525:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289538:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289548:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289554:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289559:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dec00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841976.289562:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289568:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289574:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946487ed3f00) 00010000:00010000:2.0:1787841976.289576:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841976.289579:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289584:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289638:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136b75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289651:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.289657:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:2.0:1787841976.289660:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841976.289667:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841976.289729:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:11528:x1874687858657536:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 859us (4762us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787841976.289738:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 189 00000100:00100000:1.0:1787841976.302156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.307209:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858657664 00000100:00100000:0.0:1787841976.307225:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858657664 00000100:00100000:0.0:1787841976.307769:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 190 00000100:00100000:0.0:1787841976.307795:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:11528:x1874687858657664:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:0.0:1787841976.307877:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307899:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307912:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307942:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307948:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307955:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307962:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.307967:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307975:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.307988:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:0.0:1787841976.307992:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841976.307996:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.308017:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136b98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.308142:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:11528:x1874687858657664:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 349us (5995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.308153:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 190 00000100:00100000:1.0:1787841976.310809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.310877:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858657920 00000100:00100000:3.0:1787841976.310889:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858657920 00000100:00100000:3.0:1787841976.310948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:3.0:1787841976.310958:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:11528:x1874687858657920:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841976.311211:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:11528:x1874687858657920:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 254us (410us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787841976.311219:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:1.0:1787841976.393526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.393662:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858658176 00000100:00100000:2.0:1787841976.393672:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858658176 00000100:00100000:2.0:1787841976.393729:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 191 00000100:00100000:2.0:1787841976.393739:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:11063:x1874687858658176:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787841976.393765:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841976.393787:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136b9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.393892:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.393908:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.393916:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.393949:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.393961:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 28 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841976.393974:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9944000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877528448:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841976.394136:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7ddc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841976.402542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.402655:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9944000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877528448:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841976.402686:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.402761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858658304 00000100:00100000:0.0:1787841976.402768:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858658304 00010000:00010000:0.0:1787841976.402803:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 29 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.402839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 73 00000100:00100000:0.0:1787841976.402847:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:2349:x1874687858658304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841976.402861:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841976.402867:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 29 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.402879:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 29 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.402900:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136b8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d2b expref: 29 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.402918:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:0.0:1787841976.402923:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.402932:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.402954:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.402982:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841976.403044:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:2349:x1874687858658304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 196us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.403051:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 73 00010000:00010000:1.0:1787841976.404082:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.404094:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841976.404137:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787841976.404306:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136b9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.404325:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.404333:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:1.0:1787841976.404335:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841976.404338:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dec00, rc 0) 00000100:00100000:1.0:1787841976.404433:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:11063:x1874687858658176:12345-192.168.202.46@tcp:101:bash.0 Request processed in 10695us (10917us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787841976.404441:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 191 00000100:00100000:3.0:1787841976.412727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.412831:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858658560 00000100:00100000:2.0:1787841976.412841:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858658560 00000100:00100000:2.0:1787841976.412941:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 192 00000100:00100000:2.0:1787841976.412954:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:11063:x1874687858658560:12345-192.168.202.46@tcp:36:bash.0 00010000:00010000:2.0:1787841976.413443:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.413507:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.413520:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841976.413580:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787841976.413606:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e8bd736 reply state 000000000e5dc2ff transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841976.414976:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787841976.415096:0:8624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787841976.416718:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11063:x1874687858658560:12345-192.168.202.46@tcp:36:bash.0 Request processed in 2291us (2528us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787841976.416737:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 192 00000020:00080000:2.0:1787841976.416746:0:8624:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787841976.417608:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.417631:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.417639:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.417646:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.417650:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.417658:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.417675:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:0.0:1787841976.417678:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.417682:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.417688:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136bb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841976.427944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.428052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858658688 00000100:00100000:0.0:1787841976.428062:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858658688 00000100:00100000:0.0:1787841976.428134:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 193 00000100:00100000:0.0:1787841976.428144:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:11063:x1874687858658688:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841976.428169:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841976.428190:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136bbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.428256:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d39 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.428271:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d39 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.428369:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:0.0:1787841976.428373:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841976.428377:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481000, rc 0) 00000100:00100000:0.0:1787841976.428444:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11063:x1874687858658688:12345-192.168.202.46@tcp:101:bash.0 Request processed in 302us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.428451:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 193 00000100:00100000:1.0:1787841976.432211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.432732:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858658816 00000100:00100000:2.0:1787841976.432743:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858658816 00000100:00080000:0.0:1787841976.432897:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841976.432982:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 58 00000100:00100000:2.0:1787841976.432994:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:11063:x1874687858658816:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787841976.433027:0:12012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841976.433050:0:12012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d40 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841976.433078:0:12012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a904db7, atime: 0x6a904db5, ctime: 0x6a904db7, blocks: 0xb 00010000:00010000:2.0:1787841976.433105:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787841976.433110:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841976.433118:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 8 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.433137:0:12012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 8 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.433151:0:12012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dea00, rc 0) 00000100:00100000:2.0:1787841976.433218:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:11063:x1874687858658816:12345-192.168.202.46@tcp:101:bash.0 Request processed in 226us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841976.433225:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 58 00000100:00100000:3.0:1787841976.441977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.443230:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858658944 00000100:00100000:0.0:1787841976.443245:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858658944 00002000:00010000:0.0:1787841976.443294:0:6699:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787841976.443299:0:6699:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464bfbd9680 with x1874687858658944 ext(0->18446744073709551615) 00002000:00010000:0.0:1787841976.443312:0:6699:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464bfbd9680. 00000100:00100000:0.0:1787841976.443375:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787841976.443385:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858658944:12345-192.168.202.46@tcp:10:bash.0 00002000:00010000:0.0:1787841976.443724:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787841976.443728:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787841975 -> 1787841977 00002000:00010000:0.0:1787841976.443731:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787841973 -> 1787841973 00002000:00010000:0.0:1787841976.443734:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787841975 -> 1787841977 00002000:00010000:0.0:1787841976.443736:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787841976.443807:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858658944:12345-192.168.202.46@tcp:10:bash.0 Request processed in 423us (1841us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787841976.443815:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00002000:00010000:0.0:1787841976.443819:0:6699:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787841976.443821:0:6699:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464bfbd9680 with x1874687858658944 ext(0->18446744073709551615) 00002000:00010000:0.0:1787841976.443826:0:6699:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464bfbd9680. 00000100:00100000:2.0:1787841976.556849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.557111:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858659072 00000100:00100000:0.0:1787841976.557121:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858659072 00000100:00100000:0.0:1787841976.557184:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 194 00000100:00100000:0.0:1787841976.557194:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11542:x1874687858659072:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:0.0:1787841976.557280:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557299:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557313:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557330:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557351:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557358:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557674:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557683:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557690:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841976.557727:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557737:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557743:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557750:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557756:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.557760:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557768:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557787:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841976.557790:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.557795:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557801:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136bc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557817:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557823:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557828:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557833:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.557835:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557840:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557847:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391b700) 00010000:00010000:0.0:1787841976.557849:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.557852:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557857:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557880:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557886:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557891:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557977:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841976.557980:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557986:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.557995:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:0.0:1787841976.558006:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841976.558009:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.558015:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.558106:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11542:x1874687858659072:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 912us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.558116:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 194 00000100:00100000:2.0:1787841976.561784:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877528832:0@lo:400:kworker.0 00000100:00100000:1.0:1787841976.561809:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877528960:0@lo:400:kworker.0 00000100:00100000:3.0:1787841976.561879:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9945e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877528576:0@lo:400:kworker.0 00000100:00100000:0.0:1787841976.561932:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9944b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877528704:0@lo:400:kworker.0 00000100:00100000:3.0:1787841976.570943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841976.571030:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9947840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877529088:0@lo:400:kworker.0 00000100:00100000:3.0:1787841976.571066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841976.571123:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877529088 00000100:00100000:3.0:1787841976.571132:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877529088 00000100:00100000:3.0:1787841976.571191:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787841976.571200:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877529088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841976.571270:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877529088:12345-0@lo:400:kworker.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841976.571278:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1787841976.571300:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841976.571326:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9947840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877529088:0@lo:400:kworker.0 00000100:00100000:0.0:1787841976.572053:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841976.572090:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9945a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877529216:0@lo:400:kworker.0 00000100:00100000:0.0:1787841976.572118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841976.572155:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877529216 00000100:00100000:0.0:1787841976.572160:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877529216 00000100:00100000:0.0:1787841976.572193:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787841976.572200:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877529216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841976.572239:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877529216:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.572259:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787841976.572289:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9945a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877529216:0@lo:400:kworker.0 00000100:00100000:0.0:1787841976.572319:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877528576 00000100:00100000:0.0:1787841976.572323:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877528576 00000100:00100000:0.0:1787841976.572348:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787841976.572355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841976.572392:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877528576:12345-0@lo:400:kworker.0 Request processed in 37us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.572397:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787841976.572431:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9945e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877528576:0@lo:400:kworker.0 00000100:00100000:2.0:1787841976.576189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841976.576667:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877528704 00000100:00100000:0.0:1787841976.576677:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877528704 00000100:00100000:0.0:1787841976.576734:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877528832 00000100:00100000:0.0:1787841976.576737:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877528832 00000100:00100000:2.0:1787841976.576898:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787841976.576912:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877528704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841976.579437:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877528704:12345-0@lo:400:kworker.0 Request processed in 2517us (7373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841976.579487:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787841976.579528:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787841976.579534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841976.579541:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9944780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841976.579575:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877528960 00000100:00100000:1.0:1787841976.579583:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877528960 00000100:00100000:1.0:1787841976.579618:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787841976.579637:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841976.579671:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877528960:12345-0@lo:400:kworker.0 Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841976.579677:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787841976.579709:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9944780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877528832:12345-0@lo:400:kworker.0 Request processed in 173us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841976.579715:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787841976.579826:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9944b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877528704:0@lo:400:kworker.0 00000100:00080000:0.0:1787841976.579855:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841976.580213:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877528960:0@lo:400:kworker.0 00000100:00100000:3.0:1787841976.586849:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877528832:0@lo:400:kworker.0 00000100:00100000:2.0:1787841976.619905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.620056:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858659328 00000100:00100000:3.0:1787841976.620065:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858659328 00000100:00100000:3.0:1787841976.620137:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 195 00000100:00100000:3.0:1787841976.620147:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9947c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+32:11546:x1874687858659328:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1787841976.620170:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841976.620192:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d47 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620267:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620281:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620292:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620305:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620312:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620335:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620705:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620715:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620723:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841976.620733:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787841976.620845:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620853:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620860:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620866:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841976.620871:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620879:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620891:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841976.620895:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841976.620906:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620913:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620927:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620932:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620938:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620943:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841976.620946:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620952:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620960:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9464999d2900) 00010000:00010000:3.0:1787841976.620963:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841976.620966:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.620971:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.621024:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d47 expref: 35 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.621052:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d47 expref: 34 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.621060:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:3.0:1787841976.621063:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787841976.621066:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044400, rc 0) 00000100:00100000:3.0:1787841976.621141:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9947c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11546:x1874687858659328:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 995us (1246us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787841976.621149:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 195 00000100:00100000:3.0:1787841976.636272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.636430:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858659456 00000100:00100000:0.0:1787841976.636441:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858659456 00000100:00100000:0.0:1787841976.636545:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 196 00000100:00100000:0.0:1787841976.636572:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11546:x1874687858659456:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:0.0:1787841976.636667:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.636686:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.636696:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.636737:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.636754:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 34 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.636770:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946485379e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877529344:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841976.636867:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946486013900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841976.640209:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.640349:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946485379e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877529344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841976.640379:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841976.640581:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858659712 00000100:00100000:1.0:1787841976.640600:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858659712 00000100:00100000:1.0:1787841976.640670:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:1.0:1787841976.640680:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464853792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:5586:x1874687858659712:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787841976.641136:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464853792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:5586:x1874687858659712:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 456us (935us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787841976.641143:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:2.0:1787841976.644184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.644379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858659840 00000100:00100000:3.0:1787841976.644388:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858659840 00010000:00010000:3.0:1787841976.644432:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 36 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841976.644507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 74 00000100:00100000:3.0:1787841976.644518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:2348:x1874687858659840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841976.644533:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841976.644539:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 36 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.644572:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 36 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.644596:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136ba6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d32 expref: 36 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.644628:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:3.0:1787841976.644634:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.644643:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.644650:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.644675:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841976.644732:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:2348:x1874687858659840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 215us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841976.644739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 74 00010000:00010000:2.0:1787841976.646215:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646230:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646276:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646283:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646289:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646294:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841976.646299:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646305:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646335:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:2.0:1787841976.646338:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841976.646343:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.646349:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136c01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841976.646431:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11546:x1874687858659456:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 9856us (10166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841976.646440:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 196 00000100:00100000:2.0:1787841976.649131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.649257:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858660096 00000100:00100000:3.0:1787841976.649266:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858660096 00000100:00100000:3.0:1787841976.649325:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:3.0:1787841976.649335:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+34:11546:x1874687858660096:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841976.649626:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:11546:x1874687858660096:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 278us (499us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787841976.649635:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:2.0:1787841976.721501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.721589:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858660352 00000100:00100000:3.0:1787841976.721599:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858660352 00000100:00100000:3.0:1787841976.721678:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 197 00000100:00100000:3.0:1787841976.721691:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+35:11557:x1874687858660352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1787841976.721725:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841976.721750:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d4e expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.721891:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.721910:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.721924:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.721943:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.721952:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.721959:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723041:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723056:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723076:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841976.723087:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787841976.723263:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723272:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723278:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723284:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841976.723288:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723296:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723310:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841976.723313:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841976.723318:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723324:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723339:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723344:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723357:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723363:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841976.723366:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723373:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723381:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9464999d2900) 00010000:00010000:3.0:1787841976.723384:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841976.723387:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723393:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723441:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d4e expref: 38 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723489:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d4e expref: 37 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.723497:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:3.0:1787841976.723499:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841976.723502:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031000, rc 0) 00000100:00100000:3.0:1787841976.723712:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11557:x1874687858660352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2022us (2268us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787841976.723730:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 197 00000100:00100000:0.0:1787841976.729066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.729216:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858660608 00000100:00100000:3.0:1787841976.729228:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858660608 00000100:00100000:3.0:1787841976.729331:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 54 00000100:00100000:3.0:1787841976.729343:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11557:x1874687858660608:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1787841976.729632:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:11557:x1874687858660608:12345-192.168.202.46@tcp:35:cat.0 Request processed in 291us (578us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787841976.729640:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 54 00000100:00100000:2.0:1787841976.748179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841976.748369:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858660864 00000100:00100000:1.0:1787841976.748380:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858660864 00000100:00100000:1.0:1787841976.748442:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 198 00000100:00100000:1.0:1787841976.748453:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9944b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:11558:x1874687858660864:12345-192.168.202.46@tcp:36:rm.0 00010000:00010000:1.0:1787841976.748558:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787841976.748591:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d4e expref: 38 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748629:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d47 expref: 37 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748644:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e136bbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d39 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748655:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946487ed3600) 00010000:00010000:1.0:1787841976.748669:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841976.748692:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748706:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748736:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748751:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748770:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.748776:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749107:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749129:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749136:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841976.749788:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787841976.749800:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365724341605ns, next at 366724338705ns, rc = 0 00010000:00010000:1.0:1787841976.749857:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749867:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749875:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749892:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749899:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749905:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749920:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841976.749941:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749947:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749954:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749960:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841976.749963:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749971:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.749981:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317ac00) 00010000:00010000:1.0:1787841976.749984:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787841976.749989:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750018:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e136c39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750038:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750044:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750050:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750055:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841976.750058:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750063:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750071:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:1.0:1787841976.750073:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841976.750077:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.750082:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246800/0x1d0ed3605e136c2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841976.750091:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af06ade0 reply state 000000006eb3388c transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841976.750099:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841976.750194:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9944b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+37:11558:x1874687858660864:12345-192.168.202.46@tcp:36:rm.0 Request processed in 1740us (2025us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787841976.750204:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 198 00010000:00010000:3.0:1787841976.753268:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841976.753284:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.753297:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841976.753302:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.753313:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.753333:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94649317ac00) 00010000:00010000:3.0:1787841976.753337:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841976.753343:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.753350:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247a00/0x1d0ed3605e136c40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.753378:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841976.753380:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841976.753402:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841976.755886:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.755905:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.755912:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.755918:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841976.755922:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.755930:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.755965:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94649317a200) 00010000:00010000:2.0:1787841976.755969:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841976.755974:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.755981:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e136c32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841976.804633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841976.805162:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858661120 00000100:00100000:3.0:1787841976.805173:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858661120 00000100:00100000:3.0:1787841976.805240:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 199 00000100:00100000:3.0:1787841976.805258:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9945e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+36:11564:x1874687858661120:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841976.805284:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841976.805306:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d55 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.805437:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.805453:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.805491:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.805508:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.805515:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.805523:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841976.806379:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787841976.806600:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806627:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806644:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806683:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806690:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806697:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806703:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841976.806708:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806715:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806728:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841976.806732:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841976.806737:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.806743:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136c4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841976.807020:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e521a8df reply state 00000000acdef0e5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841976.807032:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787841976.807080:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136c47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.807095:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841976.807102:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:3.0:1787841976.807104:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841976.807107:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044400, rc 0) 00000100:00100000:3.0:1787841976.807525:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9945e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:11564:x1874687858661120:12345-192.168.202.46@tcp:101:bash.0 Request processed in 2274us (2901us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787841976.807535:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 199 00010000:00010000:2.0:1787841976.814737:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.814756:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.814764:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.814771:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841976.814776:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.814783:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.814802:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9464999d2900) 00010000:00010000:2.0:1787841976.814805:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841976.814811:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841976.814817:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136c55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.822028:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841976.822351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.822849:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858661248 00000100:00100000:0.0:1787841976.822858:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858661248 00000100:00100000:0.0:1787841976.822935:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:0.0:1787841976.822948:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9945a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858661248:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:0.0:1787841976.822968:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841976.822990:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841976.823053:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841976.823073:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1787841976.823078:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841976.823088:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.823108:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.823135:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481a00, rc 0) 00000100:00100000:0.0:1787841976.823197:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9945a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2349:x1874687858661248:12345-192.168.202.46@tcp:101:bash.0 Request processed in 252us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841976.823205:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00080000:3.0:1787841976.823836:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841976.832240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841976.832336:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858661376 00000100:00100000:1.0:1787841976.832347:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858661376 00000100:00100000:1.0:1787841976.832410:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:1.0:1787841976.832419:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:11564:x1874687858661376:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:1.0:1787841976.832439:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841976.832493:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d63 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.832529:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.832539:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841976.832544:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841976.832551:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.832587:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.832602:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841976.832629:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cba1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874687877529472:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841976.832743:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841976.836258:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cba1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874687877529472:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841976.836298:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841976.836321:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246800, rc 0) 00000100:00100000:1.0:1787841976.836391:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:11564:x1874687858661376:12345-192.168.202.46@tcp:101:bash.0 Request processed in 3972us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841976.836400:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:2.0:1787841976.838735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841976.838837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858661504 00000100:00100000:0.0:1787841976.838847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858661504 00010000:00010000:0.0:1787841976.838887:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.838934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 75 00000100:00100000:0.0:1787841976.838944:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9947840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858661504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841976.838964:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841976.838991:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.839036:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.839065:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e136c6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d5c expref: 7 pid: 6694 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.839083:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841976.839088:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841976.839102:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.839114:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841976.839164:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841976.839178:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874687877529600:192.168.202.46@tcp:105: 00000100:00100000:0.0:1787841976.839271:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464860139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841976.841659:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946485378000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874687877529600:192.168.202.46@tcp:105: 00010000:00010000:2.0:1787841976.841691:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841976.841755:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9947840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2346:x1874687858661504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2812us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841976.841767:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 75 00000100:00100000:1.0:1787841976.844769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841976.844906:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858661760 00000100:00100000:2.0:1787841976.844917:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858661760 00000100:00100000:2.0:1787841976.844986:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:2.0:1787841976.845008:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+38:11564:x1874687858661760:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:2.0:1787841976.845542:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:11564:x1874687858661760:12345-192.168.202.46@tcp:35:bash.0 Request processed in 545us (783us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787841976.845551:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 55 00000100:00100000:2.0:1787841977.016882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.016983:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858661888 00000100:00100000:1.0:1787841977.017003:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858661888 00000100:00100000:1.0:1787841977.017067:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 200 00000100:00100000:1.0:1787841977.017078:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9946d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+39:11580:x1874687858661888:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787841977.017330:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841977.017355:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e136c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.017429:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e136c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.017444:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e136c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.017492:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e136c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841977.017553:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787841977.017570:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841977.017599:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e136c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.018195:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246c00/0x1d0ed3605e136c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d6a expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.018290:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e136c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d6a expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.018300:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:1.0:1787841977.018303:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841977.018307:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246200, rc 0) 00000100:00100000:1.0:1787841977.018386:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9946d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11580:x1874687858661888:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1310us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.018396:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 200 00000100:00100000:0.0:1787841977.040913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.041009:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858662144 00000100:00100000:2.0:1787841977.041019:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858662144 00000100:00100000:2.0:1787841977.041085:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 201 00000100:00100000:2.0:1787841977.041096:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+40:11580:x1874687858662144:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841977.041129:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.041152:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d71 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.041388:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.041423:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.041437:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841977.041450:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787841977.041753:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d71 expref: 43 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.041777:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d71 expref: 42 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.041786:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:2.0:1787841977.041789:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841977.041793:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de000, rc 0) 00000100:00100000:2.0:1787841977.041863:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+42:11580:x1874687858662144:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 768us (961us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787841977.041871:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 201 00000100:00100000:0.0:1787841977.045062:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.045410:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858662400 00000100:00100000:2.0:1787841977.045422:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858662400 00000100:00100000:2.0:1787841977.045525:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 202 00000100:00100000:2.0:1787841977.045535:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485379e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+42:11580:x1874687858662400:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841977.045561:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.045585:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.045887:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ca2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.045902:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.045912:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841977.045925:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787841977.046076:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d78 expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.046096:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d78 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.046103:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:2.0:1787841977.046106:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787841977.046109:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841977.046298:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485379e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:11580:x1874687858662400:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 764us (1249us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787841977.046307:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 202 00000100:00100000:1.0:1787841977.048031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.051130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858662528 00000100:00100000:2.0:1787841977.051146:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858662528 00000100:00100000:2.0:1787841977.051233:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:2.0:1787841977.051243:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+44:2349:x1874687858662528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841977.051261:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841977.051301:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d71 expref: 44 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.051323:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:2.0:1787841977.051328:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841977.051409:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:2349:x1874687858662528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 167us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.051419:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:0.0:1787841977.055551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.055690:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858662656 00000100:00100000:3.0:1787841977.055700:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858662656 00000100:00100000:3.0:1787841977.055757:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:3.0:1787841977.055768:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+6:2347:x1874687858662656:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1787841977.055817:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.055838:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.055847:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787841977.055851:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841977.055856:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.055910:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.055920:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 6 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.055932:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874687877529728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841977.056028:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464851370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841977.058001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.058131:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874687877529728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841977.058160:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.058399:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858662784 00000100:00100000:0.0:1787841977.058408:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858662784 00002000:00100000:0.0:1787841977.058531:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff946381cbb480 x1874687858662784/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:478/0 lens 504/0 e 0 to 0 dl 1787841988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841977.058551:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff946381cbb480 with x1874687858662784 ext(0->8) 00010000:00010000:0.0:1787841977.058560:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 7 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.058574:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 7 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841977.058581:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946381cbb480 00000100:00100000:0.0:1787841977.058657:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:0.0:1787841977.058667:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858662784:12345-192.168.202.46@tcp:4:lfs.0 00000100:00100000:0.0:1787841977.060052:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2348:x1874687858662784:12345-192.168.202.46@tcp:4:lfs.0 Request processed in 1379us (2060us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787841977.060064:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3 00002000:00100000:0.0:1787841977.060075:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff946381cbb480 x1874687858662784/t4294967308(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:478/0 lens 504/448 e 0 to 0 dl 1787841988 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841977.060095:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff946381cbb480 with x1874687858662784 ext(0->8) 00010000:00010000:0.0:1787841977.060104:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 9 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.060121:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 9 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841977.060128:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946381cbb480 00000100:00100000:1.0:1787841977.064819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.064888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858662912 00000100:00100000:2.0:1787841977.064896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858662912 00010000:00010000:2.0:1787841977.064934:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 9 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.065015:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:2.0:1787841977.065030:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2346:x1874687858662912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841977.065047:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787841977.065069:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787841977.065072:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787841977 00002000:00010000:2.0:1787841977.065074:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787841977 00002000:00010000:2.0:1787841977.065076:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787841977 00010000:00010000:2.0:1787841977.065082:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 9 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.065261:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 9 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.065292:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3cae2c/0x1d0ed3605e136c71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d63 expref: 9 pid: 6693 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.065323:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841977.065328:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841977.065334:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.065345:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.065381:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841977.065438:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2346:x1874687858662912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 414us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.065445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 76 00010000:00010000:3.0:1787841977.065545:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.065556:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.065583:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.065591:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.066726:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.066736:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045c00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841977.066740:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.066749:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.066764:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.066772:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016129c29/0x1d0ed3605e136cb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.066866:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858662656:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 11097us (11320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.066876:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:1.0:1787841977.070432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.070789:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858663168 00000100:00100000:3.0:1787841977.070799:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858663168 00000100:00100000:3.0:1787841977.070858:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 56 00000100:00100000:3.0:1787841977.070868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+43:11580:x1874687858663168:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:3.0:1787841977.070933:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d78 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841977.071784:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787841977.071840:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787841977.072379:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787841977.072444:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.072483:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.072493:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.072532:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.072547:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 47 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.072560:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874687877529856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841977.072970:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464851370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841977.074403:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841977.074425:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841977.074518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841977.074638:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877529984 00000100:00100000:0.0:1787841977.074660:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877529984 00000100:00100000:0.0:1787841977.074725:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787841977.074737:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877529984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841977.074763:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841977.074812:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877529984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.074818:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787841977.074870:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877529984:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787841977.075238:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841977.079106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.079418:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874687877529856:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841977.079449:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.079622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858663296 00000100:00100000:2.0:1787841977.079629:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858663296 00010000:00010000:2.0:1787841977.079668:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 48 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.079700:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:2.0:1787841977.079709:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+48:2349:x1874687858663296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841977.079723:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841977.079729:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 48 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.079742:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 48 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.079793:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136c5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d55 expref: 48 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.079813:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:2.0:1787841977.079818:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.079830:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.079839:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.079868:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841977.079926:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+47:2349:x1874687858663296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 217us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.079934:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 77 00010000:00010000:3.0:1787841977.080217:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.080226:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841977.080369:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787841977.080605:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787841977.080714:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877530112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787841977.080781:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841977.080809:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648325ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841977.081504:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877530112 00000100:00100000:2.0:1787841977.081513:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877530112 00000100:00100000:2.0:1787841977.081568:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841977.081578:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874687877530112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841977.081676:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874687877530112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.081683:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787841977.082256:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877530112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787841977.082811:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787841977.082900:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877530240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787841977.082950:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841977.082983:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bae00b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841977.083318:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877530240 00000100:00100000:2.0:1787841977.083325:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877530240 00000100:00100000:2.0:1787841977.083376:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841977.083385:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874687877530240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841977.083586:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5852:x1874687877530240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 202us (634us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787841977.083593:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787841977.084013:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd9e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874687877530240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787841977.084076:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787841977.084336:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.084348:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.084355:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.084361:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841977.084366:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.084373:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.084402:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:3.0:1787841977.084405:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787841977.084409:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.084416:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136cb7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841977.084807:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787841977.084916:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787841977.084928:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366059471027ns, next at 367059468134ns, rc = 0 00000001:00080000:3.0:1787841977.084936:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787841977.084974:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:3.0:1787841977.084978:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787841977.084986:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136ca2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d78 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.085140:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:11580:x1874687858663168:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 14272us (14716us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787841977.085148:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 56 00000020:00080000:3.0:1787841977.085154:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787841977.088823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.088970:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858663424 00000100:00100000:2.0:1787841977.088981:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858663424 00000100:00100000:2.0:1787841977.089053:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 203 00000100:00100000:2.0:1787841977.089063:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+50:11580:x1874687858663424:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841977.089100:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.089137:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136cbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d7f expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.089216:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d7f expref: 51 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.089232:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d7f expref: 51 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.089251:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.089254:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841977.089259:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df600, rc 0) 00000100:00100000:2.0:1787841977.089324:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:11580:x1874687858663424:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 261us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.089331:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 203 00000100:00100000:1.0:1787841977.093432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.093597:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858663680 00000100:00100000:3.0:1787841977.093607:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858663680 00000100:00100000:3.0:1787841977.093667:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:3.0:1787841977.093677:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+51:11580:x1874687858663680:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841977.093927:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11580:x1874687858663680:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 251us (505us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787841977.093949:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 57 00000100:00100000:1.0:1787841977.200033:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.200284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858663808 00000100:00100000:0.0:1787841977.200296:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858663808 00000100:00100000:0.0:1787841977.200366:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 204 00000100:00100000:0.0:1787841977.200376:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11590:x1874687858663808:12345-192.168.202.46@tcp:34:lfs.0 00010000:00010000:0.0:1787841977.200491:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200509:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200520:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200534:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200541:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200548:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200867:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200877:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200883:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841977.200923:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200937:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200944:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200951:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200957:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841977.200961:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200970:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.200983:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841977.200987:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841977.201003:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201017:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136cc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201035:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201041:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201047:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201053:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841977.201056:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201062:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201070:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391b400) 00010000:00010000:0.0:1787841977.201072:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841977.201075:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201080:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201094:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201099:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201110:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201115:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841977.201118:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201124:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201132:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841977.201135:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841977.201138:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.201144:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.202412:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11590:x1874687858663808:12345-192.168.202.46@tcp:34:lfs.0 Request processed in 2028us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.202424:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 204 00000100:00100000:1.0:1787841977.243737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.243973:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858664064 00000100:00100000:2.0:1787841977.243984:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858664064 00000100:00100000:2.0:1787841977.244097:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 205 00000100:00100000:2.0:1787841977.244110:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+52:11593:x1874687858664064:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841977.244162:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.244185:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d86 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244294:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244312:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244324:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244338:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244345:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244352:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244516:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244525:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244532:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841977.244542:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787841977.244663:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244671:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244677:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244682:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.244686:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244694:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244706:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841977.244710:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841977.244715:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244722:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244738:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244744:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244750:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244769:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfa00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.244780:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244787:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244795:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946487ed3300) 00010000:00010000:2.0:1787841977.244798:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841977.244801:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244806:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136ce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244849:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 55 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244864:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 54 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.244872:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.244874:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841977.244877:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df200, rc 0) 00000100:00100000:2.0:1787841977.244946:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:11593:x1874687858664064:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 840us (1219us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787841977.244955:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 205 00000100:00100000:1.0:1787841977.248907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.249005:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858664192 00000100:00100000:2.0:1787841977.249015:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858664192 00000100:00100000:2.0:1787841977.249073:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 206 00000100:00100000:2.0:1787841977.249085:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf80cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:11593:x1874687858664192:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:2.0:1787841977.249173:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249189:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249208:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249234:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249240:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249247:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249253:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.249257:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249265:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249276:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.249279:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841977.249283:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.249290:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.249377:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf80cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:11593:x1874687858664192:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 294us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.249383:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 206 00000100:00100000:1.0:1787841977.252576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.252715:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858664448 00000100:00100000:3.0:1787841977.252726:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858664448 00000100:00100000:3.0:1787841977.252789:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 58 00000100:00100000:3.0:1787841977.252799:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+54:11593:x1874687858664448:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787841977.253098:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11593:x1874687858664448:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 299us (530us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787841977.253106:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 58 00000100:00100000:1.0:1787841977.332019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.332098:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858664704 00000100:00100000:3.0:1787841977.332117:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858664704 00000100:00100000:3.0:1787841977.332176:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 207 00000100:00100000:3.0:1787841977.332186:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11603:x1874687858664704:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787841977.332217:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841977.332220:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841977.332246:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e136c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d6a expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.332265:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:3.0:1787841977.332270:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841977.332283:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d8d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.332389:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.332402:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 55 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.332423:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.332501:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 55 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.332515:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 55 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.332529:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877530368:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841977.332631:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485137540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841977.337814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.337906:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877530368:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841977.337934:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.338008:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858664832 00000100:00100000:2.0:1787841977.338015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858664832 00010000:00010000:2.0:1787841977.338055:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 56 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.338092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 78 00000100:00100000:2.0:1787841977.338101:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+56:2349:x1874687858664832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841977.338115:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841977.338122:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 56 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.338135:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 56 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.338156:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d86 expref: 56 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.338173:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.338178:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.338188:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.338221:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.338243:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841977.338288:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:2349:x1874687858664832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 188us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.338296:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 78 00010000:00010000:3.0:1787841977.338399:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.338406:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841977.338424:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787841977.338594:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.338619:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.338638:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841977.338640:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787841977.338643:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030800, rc 0) 00000100:00100000:3.0:1787841977.338665:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11603:x1874687858664704:12345-192.168.202.46@tcp:101:bash.0 Request processed in 6481us (6656us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787841977.338672:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 207 00000100:00100000:1.0:1787841977.341907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.342021:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665088 00000100:00100000:2.0:1787841977.342034:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665088 00000100:00100000:2.0:1787841977.342103:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 208 00000100:00100000:2.0:1787841977.342113:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+55:11603:x1874687858665088:12345-192.168.202.46@tcp:36:bash.0 00010000:00010000:2.0:1787841977.342417:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.342436:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.342448:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841977.342537:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787841977.342562:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e826845 reply state 00000000dc9d24f7 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.342571:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841977.343011:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:11603:x1874687858665088:12345-192.168.202.46@tcp:36:bash.0 Request processed in 897us (1114us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787841977.343018:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 208 00000020:00080000:2.0:1787841977.343023:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787841977.345759:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.345778:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.345785:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.345791:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.345796:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.345804:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.345821:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.345824:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841977.345828:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.345834:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.347032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.347112:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665216 00000100:00100000:2.0:1787841977.347123:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665216 00000100:00100000:2.0:1787841977.347178:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 209 00000100:00100000:2.0:1787841977.347189:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:11603:x1874687858665216:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787841977.347218:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.347236:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136d20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d94 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.347341:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.347355:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.347363:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.347398:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.347410:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 58 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.347423:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9946940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877530496:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787841977.347550:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7ddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841977.350536:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9946940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877530496:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787841977.350566:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.352060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.352322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665344 00000100:00100000:0.0:1787841977.352331:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665344 00010000:00010000:0.0:1787841977.352369:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 59 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.352410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00100000:0.0:1787841977.352420:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:2348:x1874687858665344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841977.352435:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841977.352491:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 59 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.352505:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 59 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.352530:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d8d expref: 59 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.352546:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841977.352551:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.352559:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.352567:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.352595:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841977.352657:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:2348:x1874687858665344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 238us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.352665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 79 00010000:00010000:3.0:1787841977.353081:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.353091:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841977.353136:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787841977.353141:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841977.353161:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.353190:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfe00/0x1d0ed3605e136d20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 58 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.353217:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 57 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.353225:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841977.353228:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841977.353231:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:3.0:1787841977.353272:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:11603:x1874687858665216:12345-192.168.202.46@tcp:101:bash.0 Request processed in 6086us (6248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.353290:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 209 00000100:00100000:1.0:1787841977.358659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.358976:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665600 00000100:00100000:3.0:1787841977.358988:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665600 00000100:00100000:3.0:1787841977.359058:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:3.0:1787841977.359069:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+57:11603:x1874687858665600:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:3.0:1787841977.359418:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:11603:x1874687858665600:12345-192.168.202.46@tcp:35:bash.0 Request processed in 350us (770us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787841977.359426:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 59 00000100:00100000:1.0:1787841977.421651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.422141:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665728 00000100:00100000:0.0:1787841977.422151:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665728 00000100:00100000:0.0:1787841977.422277:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 210 00000100:00100000:0.0:1787841977.422289:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b995b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+58:11609:x1874687858665728:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841977.422323:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841977.422352:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97d9b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.422514:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136d35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.422532:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.422547:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841977.422627:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787841977.422634:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841977.422663:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.422694:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d9b expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.422716:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d9b expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.422726:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841977.422729:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841977.422733:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480e00, rc 0) 00000100:00100000:0.0:1787841977.423000:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b995b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11609:x1874687858665728:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 702us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.423008:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 210 00000100:00100000:1.0:1787841977.426030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.426668:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665856 00000100:00100000:2.0:1787841977.426679:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665856 00000100:00100000:2.0:1787841977.426746:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 211 00000100:00100000:2.0:1787841977.427435:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486737c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11609:x1874687858665856:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841977.427474:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.427510:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427576:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427591:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427614:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427630:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427638:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427644:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427747:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427770:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427778:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841977.427814:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787841977.427819:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841977.427838:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427858:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427867:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427874:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427881:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427887:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.427891:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427898:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427910:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841977.427914:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841977.427919:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427926:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427944:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427950:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427960:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427965:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.427968:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427974:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.427982:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946487ed3300) 00010000:00010000:2.0:1787841977.427984:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841977.427987:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.428003:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.428043:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.428058:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.428065:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.428067:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841977.428070:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de000, rc 0) 00000100:00100000:2.0:1787841977.428731:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486737c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11609:x1874687858665856:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1974us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.428750:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 211 00000100:00100000:1.0:1787841977.433813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.433893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.434145:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858666240 00000100:00100000:3.0:1787841977.434155:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858666240 00000100:00100000:3.0:1787841977.434321:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 212 00000100:00100000:3.0:1787841977.434333:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486735e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11609:x1874687858666240:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1787841977.434356:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841977.434376:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97da9 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.434524:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.434541:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.434550:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.434557:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.434708:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.434724:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 61 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.434740:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877530624:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841977.435010:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.435019:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.435029:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbdb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877530752:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841977.435053:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff946488368f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841977.435131:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858665984 00000100:00100000:0.0:1787841977.435136:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858665984 00010000:00010000:0.0:1787841977.435170:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 62 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.435242:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:0.0:1787841977.435251:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+62:2349:x1874687858665984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841977.435260:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841977.435265:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 62 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.435278:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 62 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.435296:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841977.435301:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.435308:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.435314:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841977.435340:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+62:2349:x1874687858665984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.435347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 80 00010000:00010000:3.0:1787841977.439041:0:8624:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from blocking AST (req@00000000af95fc1f x1874687877530624) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 61 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.439068:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e136d51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da2 expref: 61 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.439089:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877530624:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841977.439114:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbdb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8624:1874687877530752:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841977.439139:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841977.439157:0:8624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.439167:0:8624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.439175:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.440893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.441006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858666368 00000100:00100000:2.0:1787841977.441016:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858666368 00010000:00010000:2.0:1787841977.441059:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841977.441146:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:2.0:1787841977.441159:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:2348:x1874687858666368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841977.441178:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841977.441186:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.441317:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.441345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d94 expref: 61 pid: 8624 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.441364:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.441369:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.441381:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.441389:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.441441:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841977.441534:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:2348:x1874687858666368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 378us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.441542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 81 00010000:00010000:3.0:1787841977.442694:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.442706:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841977.442728:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787841977.442912:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 61 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.442932:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 60 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.442941:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841977.442943:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787841977.442946:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030200, rc 0) 00000100:00100000:3.0:1787841977.443010:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486735e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11609:x1874687858666240:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 8679us (9116us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787841977.443019:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 212 00000100:00100000:1.0:1787841977.446938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.447029:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858666624 00000100:00100000:0.0:1787841977.447041:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858666624 00000100:00100000:0.0:1787841977.447124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787841977.447136:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11609:x1874687858666624:12345-192.168.202.46@tcp:103:lfs.0 00010000:00010000:0.0:1787841977.447154:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841977.447196:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136cbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d7f expref: 60 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.447217:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841977.447222:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841977.447282:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11609:x1874687858666624:12345-192.168.202.46@tcp:103:lfs.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.447291:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:1.0:1787841977.449895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.449984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858666752 00000100:00100000:0.0:1787841977.450005:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858666752 00000100:00100000:0.0:1787841977.450068:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 213 00000100:00100000:0.0:1787841977.450080:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11609:x1874687858666752:12345-192.168.202.46@tcp:58:lfs.0 00010000:00010000:0.0:1787841977.450214:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.450232:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.450244:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841977.450507:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787841977.450593:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464903ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11609:x1874687858666752:12345-192.168.202.46@tcp:58:lfs.0 Request processed in 513us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.450612:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 213 00000100:00100000:1.0:1787841977.453509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.453591:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858666880 00000100:00100000:2.0:1787841977.453601:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858666880 00000100:00100000:2.0:1787841977.453669:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 214 00000100:00100000:2.0:1787841977.453680:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648c913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+59:11609:x1874687858666880:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787841977.453705:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.453728:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97db0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.453980:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.454002:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.454024:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.454039:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.454053:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.454057:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841977.454060:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.454083:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787841977.454156:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648c913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11609:x1874687858666880:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 478us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.454164:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 214 00000100:00100000:0.0:1787841977.586184:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877530880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841977.586274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.586484:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877530880 00000100:00100000:1.0:1787841977.586493:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877530880 00000100:00100000:1.0:1787841977.586568:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841977.586578:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877530880:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787841977.586801:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787841977.586833:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841977.586898:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877530880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.586907:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787841977.587010:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877530880:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787841977.649936:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841977.649946:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841977.649999:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787841977.650010:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841977.650396:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877531008:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841977.652522:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff946486013a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841977.659735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.660016:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858667008 00000100:00100000:2.0:1787841977.660026:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858667008 00000100:00100000:2.0:1787841977.660083:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 215 00000100:00100000:2.0:1787841977.660094:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858667008:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841977.660148:0:5850:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841977.660257:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858667008:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 164us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.660265:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 215 00000100:00100000:0.0:1787841977.661861:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877531008:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841977.675956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.681763:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858667136 00000100:00100000:3.0:1787841977.681795:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858667136 00000100:00100000:3.0:1787841977.682853:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 216 00000100:00100000:3.0:1787841977.682870:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11610:x1874687858667136:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787841977.682949:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.682966:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.682978:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683006:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683014:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683021:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683043:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683050:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683057:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841977.683094:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787841977.683098:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841977.683128:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683139:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683146:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683153:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683159:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841977.683162:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683170:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683182:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:3.0:1787841977.683185:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841977.683189:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683196:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136d7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683209:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683216:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683222:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683241:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841977.683245:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683253:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683261:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9464999d2c00) 00010000:00010000:3.0:1787841977.683264:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841977.683266:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683272:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136d82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683287:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683293:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683299:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683304:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841977.683307:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683313:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683332:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841977.683334:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841977.683338:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.683343:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.683432:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11610:x1874687858667136:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 Request processed in 566us (7485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.683440:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 216 00000100:00100000:1.0:1787841977.691039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.691140:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858667392 00000100:00100000:2.0:1787841977.691152:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858667392 00000100:00100000:2.0:1787841977.691216:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 217 00000100:00100000:2.0:1787841977.691226:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ac21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+60:11610:x1874687858667392:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841977.691259:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.691280:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97db7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691391:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691408:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691439:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841977.691453:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787841977.691582:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691589:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691595:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691601:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.691605:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691612:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691624:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841977.691626:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787841977.691631:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691637:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.691975:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d90 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db7 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.692011:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:2.0:1787841977.692013:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841977.692018:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136d90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db7 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.692028:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787841977.692152:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ac21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858667392:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 927us (1122us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787841977.692161:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 217 00000100:00100000:1.0:1787841977.712509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.712765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858667520 00000100:00100000:0.0:1787841977.712776:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858667520 00000100:00100000:0.0:1787841977.712843:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 218 00000100:00100000:0.0:1787841977.712854:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858667520:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841977.712895:0:5851:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787841977.713032:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858667520:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 179us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.713041:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 218 00000100:00100000:1.0:1787841977.727151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.727429:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858667776 00000100:00100000:2.0:1787841977.727441:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858667776 00000100:00100000:2.0:1787841977.727524:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 219 00000100:00100000:2.0:1787841977.727535:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858667776:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841977.727556:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841977.727559:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787841977.727586:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136d35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d9b expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.727621:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:2.0:1787841977.727627:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841977.727649:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136da5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97dbe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841977.728102:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787841977.729184:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.729215:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.729226:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.729307:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de800/0x1d0ed3605e136da5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dbe expref: 63 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.729328:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dbe expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.729337:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff946487ed3300) 00010000:00010000:2.0:1787841977.729339:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841977.729343:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de400, rc 0) 00000100:00100000:2.0:1787841977.729417:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf8030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+62:11610:x1874687858667776:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 1884us (2276us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787841977.729427:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 219 00000100:00100000:2.0:1787841977.741656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.741806:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858668032 00000100:00100000:0.0:1787841977.741817:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858668032 00000100:00100000:0.0:1787841977.741877:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 220 00000100:00100000:0.0:1787841977.741888:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9946940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+62:11610:x1874687858668032:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841977.741957:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841977.741985:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de400/0x1d0ed3605e136dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dbe expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742021:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff946487ed3300) 00010000:00010000:0.0:1787841977.742034:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841977.742072:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742101:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742111:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742127:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742134:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742141:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742220:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742229:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742364:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742373:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841977.742379:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742387:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742408:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841977.742411:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841977.742415:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742422:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136dba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742433:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742439:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742445:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742450:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841977.742453:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742510:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742518:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb44545d1 (ffff94648391b400) 00010000:00010000:0.0:1787841977.742520:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841977.742523:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.742529:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136dc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb44545d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.742641:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9946940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858668032:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 753us (994us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841977.742649:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 220 00000100:00100000:1.0:1787841977.751802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.751878:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858668160 00000100:00100000:3.0:1787841977.751889:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858668160 00000100:00100000:3.0:1787841977.751949:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 221 00000100:00100000:3.0:1787841977.751960:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+61:11610:x1874687858668160:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841977.751981:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841977.752013:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136dc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97dc5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.752051:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.752066:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.752086:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.752345:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e136dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.752377:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.752386:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:3.0:1787841977.752390:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787841977.752395:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2045c00, rc 0) 00000100:00100000:3.0:1787841977.752512:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+62:11610:x1874687858668160:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 554us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.752519:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 221 00000100:00100000:3.0:1787841977.757948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.758060:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858668416 00000100:00100000:1.0:1787841977.758073:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858668416 00000100:00100000:1.0:1787841977.758158:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 222 00000100:00100000:1.0:1787841977.758168:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+62:11610:x1874687858668416:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841977.758257:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.758275:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.758288:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841977.758616:0:8624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787841977.758628:0:8624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366733170350ns, next at 367733167233ns, rc = 0 00000004:00010000:1.0:1787841977.758725:0:8624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af95fc1f reply state 00000000ff1abe70 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.758735:0:8624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841977.758830:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+64:11610:x1874687858668416:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 662us (892us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787841977.758837:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 222 00000100:00100000:2.0:1787841977.763646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1787841977.764072:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.764093:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.764101:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.764108:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841977.764118:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.764127:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.764142:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:0.0:1787841977.764145:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787841977.764150:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.764156:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247400/0x1d0ed3605e136dd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.764502:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858668544 00000100:00100000:1.0:1787841977.764514:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858668544 00000100:00100000:1.0:1787841977.764574:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 223 00000100:00100000:1.0:1787841977.764585:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9944f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+63:11610:x1874687858668544:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841977.764609:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841977.764630:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97dcc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.764708:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.764723:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.764745:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:1.0:1787841977.764748:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841977.764750:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247200, rc 0) 00000100:00100000:1.0:1787841977.764820:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9944f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+64:11610:x1874687858668544:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 236us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.764827:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 223 00000100:00100000:2.0:1787841977.768506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.768876:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858668672 00000100:00100000:3.0:1787841977.768886:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858668672 00000100:00100000:3.0:1787841977.768946:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 62 00000100:00100000:3.0:1787841977.768956:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9945680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858668672:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787841977.769423:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9945680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2349:x1874687858668672:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 467us (974us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787841977.769431:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 62 00000100:00100000:2.0:1787841977.777806:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.777906:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858668928 00000100:00100000:3.0:1787841977.777917:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858668928 00000100:00100000:3.0:1787841977.777995:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:3.0:1787841977.778007:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+64:11610:x1874687858668928:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787841977.778762:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+65:11610:x1874687858668928:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 755us (966us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787841977.778770:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 60 00000100:00100000:2.0:1787841977.786707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.789266:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858669184 00000100:00100000:1.0:1787841977.789283:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858669184 00000100:00100000:1.0:1787841977.789430:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 224 00000100:00100000:1.0:1787841977.789443:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9947840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+65:11610:x1874687858669184:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841977.789593:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9947840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+65:11610:x1874687858669184:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 152us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.789612:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 224 00000100:00100000:2.0:1787841977.794567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.804785:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858669312 00000100:00100000:0.0:1787841977.804801:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858669312 00000100:00100000:0.0:1787841977.804874:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 225 00000100:00100000:0.0:1787841977.804900:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+65:11610:x1874687858669312:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841977.804921:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841977.804946:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136de4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.805026:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.805041:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.805052:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841977.805103:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841977.805762:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.805796:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136de4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dd3 expref: 67 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.805816:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dd3 expref: 66 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.805825:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:0.0:1787841977.805827:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787841977.805830:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787841977.805904:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+66:11610:x1874687858669312:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 1006us (11350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.805923:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 225 00000100:00100000:2.0:1787841977.811580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.811662:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858669440 00000100:00100000:0.0:1787841977.811673:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858669440 00000100:00100000:0.0:1787841977.811732:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:0.0:1787841977.811743:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+10:2349:x1874687858669440:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841977.811762:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841977.811780:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97dda expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841977.811803:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904dba, blocks: 0x1 00010000:00010000:0.0:1787841977.811819:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1787841977.811823:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841977.811830:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.811845:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.811858:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787841977.811920:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:2349:x1874687858669440:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 179us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.811928:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:2.0:1787841977.817743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.817841:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858669696 00000100:00100000:3.0:1787841977.817853:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858669696 00000100:00100000:3.0:1787841977.817912:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 226 00000100:00100000:3.0:1787841977.817922:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+66:11610:x1874687858669696:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787841977.818059:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+66:11610:x1874687858669696:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.818068:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 226 00000100:00100000:2.0:1787841977.821182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.821311:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858669824 00000100:00100000:3.0:1787841977.821322:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858669824 00000100:00100000:3.0:1787841977.821379:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:3.0:1787841977.821389:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:11610:x1874687858669824:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841977.821407:0:12012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841977.821425:0:12012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97de1 expref: -99 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.821486:0:12012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.821496:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841977.821500:0:12012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841977.821505:0:12012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 12 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.821539:0:12012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.821564:0:12012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.821579:0:12012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12012:1874687877531136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841977.821687:0:12012:0:(client.c:2715:ptlrpc_set_wait()) set ffff946488368f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841977.826489:0:12012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12012:1874687877531136:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841977.826529:0:12012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 12 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.826547:0:12012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044400, rc 0) 00000100:00100000:3.0:1787841977.826599:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:11610:x1874687858669824:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 5212us (5429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.826606:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:2.0:1787841977.827242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.827314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858669952 00000100:00100000:0.0:1787841977.827321:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858669952 00010000:00010000:0.0:1787841977.827357:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.827420:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00100000:0.0:1787841977.827429:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+12:2349:x1874687858669952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841977.827443:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841977.827486:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.827500:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.827523:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e136df2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dda expref: 12 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.827538:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841977.827542:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841977.827550:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 11 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.827561:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 11 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.827594:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 11 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.827607:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1874687877531264:192.168.202.46@tcp:105: 00000100:00100000:0.0:1787841977.827683:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff946486013000 going to sleep for 11 seconds 00000100:00100000:0.0:1787841977.838910:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1874687877531264:192.168.202.46@tcp:105: 00010000:00010000:0.0:1787841977.838941:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841977.839028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:2349:x1874687858669952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11598us (11788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841977.839040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 82 00010000:00010000:2.0:1787841977.841703:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841977.848206:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841977.852476:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858670080 00000100:00100000:2.0:1787841977.852492:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858670080 00002000:00100000:2.0:1787841977.852563:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9464bfbd9a40 x1874687858670080/t0(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:478/0 lens 504/0 e 0 to 0 dl 1787841988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841977.852577:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464bfbd9a40 with x1874687858670080 ext(0->12) 00002000:00010000:2.0:1787841977.852584:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464bfbd9a40 00000100:00100000:2.0:1787841977.852773:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:2.0:1787841977.852785:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+11:2349:x1874687858670080:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787841977.854501:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2349:x1874687858670080:12345-192.168.202.46@tcp:4:lhsmtool_posix.0 Request processed in 1708us (6294us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787841977.854514:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00002000:00100000:2.0:1787841977.854526:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9464bfbd9a40 x1874687858670080/t4294967320(0) o4->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:478/0 lens 504/448 e 0 to 0 dl 1787841988 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841977.854536:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9464bfbd9a40 with x1874687858670080 ext(0->12) 00002000:00010000:2.0:1787841977.854540:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9464bfbd9a40 00000100:00100000:2.0:1787841977.873674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.874219:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858670208 00000100:00100000:1.0:1787841977.874232:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858670208 00000100:00100000:1.0:1787841977.874306:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 227 00000100:00100000:1.0:1787841977.874317:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+66:11610:x1874687858670208:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787841977.931349:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00000001:00080000:0.0:1787841977.931380:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1787841977.931385:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1787841977.931405:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787841977.931420:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94648a66b300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787841977.931426:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9464866f3600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9464c214ecc0 00000020:00080000:0.0:1787841977.931429:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9464866f3300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9463820d7400 00000001:00080000:0.0:1787841977.931500:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787841977.931515:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787841977.931530:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946485137480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787841977.931533:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94648b38c840 00000020:00080000:0.0:1787841977.931536:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648507c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94638121d800 00000020:00080000:0.0:1787841977.931569:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787841977.931800:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787841977.932209:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11610:x1874687858670208:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 Request processed in 57889us (58539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.932220:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 227 00000100:00100000:1.0:1787841977.932614:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877531520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787841977.932696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.932755:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841977.932762:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877531392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787841977.932783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.932812:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877531520 00000100:00100000:1.0:1787841977.932821:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877531520 00000100:00100000:1.0:1787841977.932854:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877531392 00000100:00100000:1.0:1787841977.932858:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877531392 00000100:00100000:1.0:1787841977.932875:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787841977.932883:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1874687877531520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787841977.933037:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787841977.933041:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787841978 00002000:00010000:1.0:1787841977.933044:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787841977.933047:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787841978 -> 1787841978 00002000:00010000:1.0:1787841977.933049:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787841977.933106:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1874687877531520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (402us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787841977.933114:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787841977.933128:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841977.933135:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1874687877531392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787841977.933149:0:6691:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787841977.933169:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.933189:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 12 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.933211:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787841977.933215:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841977.933220:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.933591:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 12 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.933720:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 12 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.933735:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877531648:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787841977.933791:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464870a8780 going to sleep for 11 seconds 00000004:00080000:1.0:1787841977.933846:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464b99561c0/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787841977.933852:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877531520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787841977.937588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.937641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841977.937742:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858670464 00000100:00100000:1.0:1787841977.937752:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858670464 00000100:00100000:1.0:1787841977.937876:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:1.0:1787841977.937886:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+13:2348:x1874687858670464:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787841977.938057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858670336 00000100:00100000:3.0:1787841977.938061:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858670336 00010000:00010000:3.0:1787841977.938097:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 14 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.938316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 83 00000100:00100000:3.0:1787841977.938324:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2348:x1874687858670336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841977.938353:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841977.938360:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 14 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.938377:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 14 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.938408:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841977.938413:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841977.938420:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.938432:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.938489:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841977.938548:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+14:2348:x1874687858670336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 225us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841977.938556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 83 00010000:00010000:0.0:1787841977.938802:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e136bc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d40 expref: 13 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841977.938819:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1874687877531648:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841977.938839:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.938856:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.938862:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.938872:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.938878:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.938894:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841977.940848:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841977.940857:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.940877:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787841977.940881:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.940889:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.940905:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.940910:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e136e00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.940930:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.940931:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.940932:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841977.941939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877531776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787841977.942017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841977.942130:0:12012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787841977.942140:0:12012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787841977.942807:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877531776 00000100:00100000:0.0:1787841977.942814:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877531776 00000100:00100000:3.0:1787841977.942937:0:12468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841977.942948:0:12468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1874687877531776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787841977.942971:0:12468:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787841977.943012:0:12468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a904db9, atime: 0x6a904db9, ctime: 0x6a904db9, blocks: 0x1 00010000:00010000:3.0:1787841977.943020:0:12468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.943041:0:12468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1787841977.943046:0:12468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841977.943052:0:12468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.943066:0:12468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.943198:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1874687877531392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10062us (10411us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787841977.943207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1787841977.943477:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464b9956580/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787841977.943485:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b9956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877531392:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787841977.943613:0:12468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.943621:0:12468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.943740:0:12468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787841977.944225:0:12468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1874687877531776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1278us (2206us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787841977.944302:0:12468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1787841977.944654:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464bfbd8780/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787841977.944671:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877531776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787841977.944764:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841977.944773:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.944783:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787841977.944787:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.944812:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.944831:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.944839:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a343ef79/0x1d0ed3605e136e07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.944863:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841977.944865:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841977.944867:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787841977.984887:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1787841977.984908:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1787841977.984925:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1787841977.985214:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858670464:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 Request processed in 47208us (47450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841977.985229:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:1.0:1787841977.989169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841977.989640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858670720 00000100:00100000:3.0:1787841977.989652:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858670720 00000100:00100000:3.0:1787841977.989717:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 228 00000100:00100000:3.0:1787841977.989728:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464932e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11610:x1874687858670720:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841977.989800:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841977.989840:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480000/0x1d0ed3605e136deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dd3 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.989862:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:3.0:1787841977.989867:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841977.989898:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.989912:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.989922:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841977.990206:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080688829 reply state 000000004b82893b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.990216:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841977.990451:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464932e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:11610:x1874687858670720:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 724us (1289us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787841977.990504:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 228 00010000:00010000:2.0:1787841977.992908:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.992944:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.992952:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.992958:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841977.992963:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.992972:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.992999:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:2.0:1787841977.993002:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841977.993007:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.993014:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.994937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841977.995348:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858670848 00000100:00100000:0.0:1787841977.995359:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858670848 00000100:00100000:0.0:1787841977.995418:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:0.0:1787841977.995429:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858670848:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787841977.995894:0:12012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787841977.995899:0:12012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787841978 -> 1787841978 00002000:00010000:2.0:1787841977.995901:0:12012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787841977 00002000:00010000:2.0:1787841977.995903:0:12012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787841978 -> 1787841978 00002000:00010000:2.0:1787841977.995905:0:12012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787841977.995971:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf904f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2349:x1874687858670848:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 542us (1043us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787841977.995981:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:0.0:1787841977.999960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841978.000056:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858671104 00000100:00100000:3.0:1787841978.000066:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858671104 00000100:00100000:3.0:1787841978.000148:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 229 00000100:00100000:3.0:1787841978.000160:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:11610:x1874687858671104:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787841978.000405:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.000428:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.000497:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.000534:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.000548:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 20 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.000563:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbdbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877531904:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841978.000772:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff946488368540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841978.004861:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbdbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874687877531904:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787841978.004891:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.005334:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841978.005622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858671232 00000100:00100000:0.0:1787841978.005630:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858671232 00010000:00010000:0.0:1787841978.005722:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 21 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841978.005773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:0.0:1787841978.005783:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:2349:x1874687858671232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841978.005799:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841978.005815:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 21 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.005826:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 21 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.005848:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e136dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dc5 expref: 21 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.005865:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:0.0:1787841978.005869:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.005878:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.005886:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.005906:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841978.005958:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:2349:x1874687858671232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 176us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841978.005967:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 84 00010000:00010000:1.0:1787841978.006229:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006247:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006277:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006283:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006290:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006296:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787841978.006300:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006308:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006316:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:1.0:1787841978.006319:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787841978.006323:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.006329:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841978.006386:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11610:x1874687858671104:12345-192.168.202.46@tcp:55:lhsmtool_posix.0 Request processed in 6228us (6434us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787841978.006402:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 229 00000100:00080000:3.0:1787841978.008054:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841978.010536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841978.010704:0:12468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858671360 00000100:00100000:0.0:1787841978.010715:0:12468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858671360 00000100:00100000:0.0:1787841978.010773:0:12468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00100000:0.0:1787841978.010784:0:12468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2348:x1874687858671360:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787841978.010829:0:12468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.010863:0:12468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 8 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.010871:0:12468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841978.010875:0:12468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841978.010880:0:12468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.010917:0:12468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 8 pid: 12012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.010932:0:12468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 8 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841978.010947:0:12468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464853792c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12468:1874687877532032:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841978.011048:0:12468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464812ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841978.014003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841978.014082:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858671488 00000100:00100000:1.0:1787841978.014094:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858671488 00010000:00010000:1.0:1787841978.014136:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 9 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841978.014181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:1.0:1787841978.014191:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648537a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858671488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841978.014207:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841978.014231:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 9 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.014245:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 9 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.014271:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841978.014275:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841978.014280:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.014291:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.014312:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841978.014363:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648537a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+9:2349:x1874687858671488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 174us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841978.014387:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 85 00010000:00010000:3.0:1787841978.015029:0:12468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20b6558/0x1d0ed3605e136df9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de1 expref: 8 pid: 12012 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.015047:0:12468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464853792c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12468:1874687877532032:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841978.015067:0:12468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015091:0:12468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015097:0:12468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015140:0:12468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015149:0:12468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015158:0:12468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015165:0:12468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787841978.015169:0:12468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015179:0:12468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015192:0:12468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.015201:0:12468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c953e04/0x1d0ed3605e136e1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.015298:0:12468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2348:x1874687858671360:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 Request processed in 4515us (4773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841978.015306:0:12468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 70 00000100:00080000:2.0:1787841978.016252:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841978.019306:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841978.019398:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858671744 00000100:00100000:3.0:1787841978.019408:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858671744 00000100:00100000:3.0:1787841978.019525:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 230 00000100:00100000:3.0:1787841978.019537:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464853792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11610:x1874687858671744:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787841978.019628:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019646:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019658:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019897:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019909:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019917:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019955:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.019969:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 20 pid: 5850 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.019994:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877532160:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787841978.020270:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946488368f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841978.027907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841978.028549:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877532160:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787841978.028592:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841978.028672:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858671872 00000100:00100000:2.0:1787841978.028679:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858671872 00010000:00010000:2.0:1787841978.028718:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 21 pid: 5850 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841978.028749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:2.0:1787841978.028817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf905e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:2348:x1874687858671872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841978.028835:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841978.028843:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 21 pid: 5850 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.028855:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 21 pid: 5850 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.028881:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e136ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dcc expref: 21 pid: 5850 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.028896:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:2.0:1787841978.028901:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.028909:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.028917:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.028943:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841978.029028:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf905e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:2348:x1874687858671872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 214us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841978.029036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 86 00010000:00010000:3.0:1787841978.029096:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.029211:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841978.029390:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787841978.029564:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787841978.029608:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787841978.029691:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874687877532288:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787841978.029743:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841978.030221:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946493121480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841978.031919:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877532288 00000100:00100000:2.0:1787841978.031934:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877532288 00000100:00100000:2.0:1787841978.032049:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841978.032060:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874687877532288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787841978.032203:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874687877532288:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841978.032210:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787841978.032273:0:5849:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787841978.032279:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1787841978.032296:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464b99561c0, transno 4294967321 00000004:00080000:3.0:1787841978.032309:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464b9956580, transno 4294967322 00000100:00100000:3.0:1787841978.032317:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874687877532288:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787841978.032822:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787841978.032897:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874687877532416:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787841978.032934:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841978.033660:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946488368540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841978.033687:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877532416 00000100:00100000:0.0:1787841978.033693:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877532416 00000100:00100000:0.0:1787841978.033724:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787841978.033732:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874687877532416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787841978.033975:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874687877532416:12345-0@lo:1000:mdt00_000.0 Request processed in 243us (1039us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787841978.033991:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787841978.034178:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874687877532416:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787841978.034213:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034232:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034240:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034246:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841978.034252:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034259:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034276:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9464999d2c00) 00010000:00010000:3.0:1787841978.034280:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841978.034284:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034291:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e136e2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034319:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034325:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034331:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034336:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787841978.034343:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034350:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034358:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841978.034360:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841978.034367:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034378:0:5849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034387:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841978.034412:0:5849:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.034422:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbdb840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877532544:192.168.202.46@tcp:105: 00000100:00100000:2.0:1787841978.037497:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff946488368540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841978.039772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841978.040312:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbdb840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874687877532544:192.168.202.46@tcp:105: 00010000:00010000:2.0:1787841978.040345:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040357:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136d6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040390:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040405:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040416:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040426:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040432:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040453:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040513:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841978.040517:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040524:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040536:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841978.040540:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841978.040543:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040549:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df600/0x1d0ed3605e136e31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040561:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040566:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040571:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040575:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841978.040578:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040593:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040613:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841978.040616:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841978.040619:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.040625:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030800/0x1d0ed3605e136e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841978.040861:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464853792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11610:x1874687858671744:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 21324us (21562us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787841978.040873:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 230 00000020:00080000:2.0:1787841978.040878:0:5849:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787841978.041159:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841978.041166:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841978.041797:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787841978.041807:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841978.042256:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858672000 00000100:00100000:0.0:1787841978.042267:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858672000 00000100:00100000:0.0:1787841978.042359:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:0.0:1787841978.042370:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11609:x1874687858672000:12345-192.168.202.46@tcp:49:lfs.0 00000100:00100000:0.0:1787841978.042523:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11609:x1874687858672000:12345-192.168.202.46@tcp:49:lfs.0 Request processed in 155us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841978.042532:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 61 00000100:00100000:1.0:1787841978.045098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841978.045273:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858672256 00000100:00100000:3.0:1787841978.045282:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858672256 00000100:00100000:3.0:1787841978.045340:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 231 00000100:00100000:3.0:1787841978.045350:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11609:x1874687858672256:12345-192.168.202.46@tcp:58:lfs.0 00000040:00080000:3.0:1787841978.045757:0:8624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787841978.045836:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11609:x1874687858672256:12345-192.168.202.46@tcp:58:lfs.0 Request processed in 487us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841978.045856:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 231 00000100:00100000:3.0:1787841978.047432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841978.054427:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858672512 00000100:00100000:2.0:1787841978.054444:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858672512 00000100:00100000:2.0:1787841978.054520:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 62 00000100:00100000:2.0:1787841978.054531:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+23:11610:x1874687858672512:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787841978.055901:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787841978.056027:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787841978.056243:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.056260:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.056273:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.056294:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.056301:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.056308:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841978.056386:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787841978.056530:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+25:11610:x1874687858672512:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 1997us (9102us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787841978.056540:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 62 00000020:00080000:2.0:1787841978.056545:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787841978.063250:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841978.063266:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.063278:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787841978.063283:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.063293:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.063312:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff946487ed3d00) 00010000:00010000:1.0:1787841978.063316:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787841978.063321:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.063328:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df200/0x1d0ed3605e136e38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.063356:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841978.063358:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841978.063361:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841978.085700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841978.085919:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858672640 00000100:00100000:0.0:1787841978.085929:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858672640 00000100:00100000:0.0:1787841978.085996:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 232 00000100:00100000:0.0:1787841978.086007:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+25:11612:x1874687858672640:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787841978.086036:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841978.086059:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136e3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97de8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086137:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086150:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086162:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086175:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086182:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086204:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086525:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086535:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 26 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086544:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086575:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 26 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.086590:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 26 pid: 8624 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841978.086617:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cbad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877532672:192.168.202.46@tcp:104: 00000100:00100000:0.0:1787841978.086702:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464812ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841978.090868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841978.090949:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858672896 00000100:00100000:2.0:1787841978.090959:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858672896 00000100:00100000:2.0:1787841978.091027:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:2.0:1787841978.091038:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfbdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:5587:x1874687858672896:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787841978.091302:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfbdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:5587:x1874687858672896:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 265us (443us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787841978.091311:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 63 00000100:00100000:0.0:1787841978.092056:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cbad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874687877532672:192.168.202.46@tcp:104: 00010000:00010000:0.0:1787841978.092094:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841978.094141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841978.094650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858673024 00000100:00100000:0.0:1787841978.094659:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858673024 00010000:00010000:0.0:1787841978.094700:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 28 pid: 8624 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841978.094773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00100000:0.0:1787841978.094784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:2348:x1874687858673024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841978.094799:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841978.094806:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 28 pid: 8624 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.094818:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 28 pid: 8624 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.094840:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e136d5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97da9 expref: 28 pid: 8624 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.094857:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841978.094863:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.094873:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.094881:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.095122:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841978.095186:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:2348:x1874687858673024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 403us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841978.095195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 87 00010000:00010000:1.0:1787841978.096542:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841978.096556:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841978.096662:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787841978.096682:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841978.096707:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096725:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096736:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096743:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096750:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096770:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841978.096774:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096782:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096795:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:0.0:1787841978.096799:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841978.096804:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096810:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480e00/0x1d0ed3605e136e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096824:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096840:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096846:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096851:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841978.096854:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096860:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096867:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648391b600) 00010000:00010000:0.0:1787841978.096869:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841978.096872:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096877:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096917:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481a00/0x1d0ed3605e136e3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de8 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096931:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de8 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841978.096937:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841978.096939:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841978.096948:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787841978.097066:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:11612:x1874687858672640:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 11060us (11377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841978.097084:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 232 00000001:00080000:1.0:1787841978.665086:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1787841978.665107:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787841978.665114:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1787841978.867880:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841978.939424:0:12508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841978.939433:0:12508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841978.942149:0:12508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787841978.942163:0:12508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787841979.058191:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841979.058203:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841979.058259:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787841979.058268:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841979.058409:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a7403c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877532800:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841979.058530:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff946382f51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841979.070282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841979.070529:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858673152 00000100:00100000:2.0:1787841979.070539:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858673152 00000100:00100000:2.0:1787841979.070607:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 233 00000100:00100000:2.0:1787841979.070617:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:11624:x1874687858673152:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841979.070658:0:8624:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841979.070769:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:11624:x1874687858673152:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 141us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841979.070784:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 233 00000100:00100000:0.0:1787841979.071216:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a7403c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11686:1874687877532800:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841979.075604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841979.075704:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858673408 00000100:00100000:2.0:1787841979.075713:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858673408 00000100:00100000:2.0:1787841979.075769:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 234 00000100:00100000:2.0:1787841979.075778:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+26:11624:x1874687858673408:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841979.075801:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841979.075825:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97def expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.075930:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.075945:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.075959:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841979.075971:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787841979.076107:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97def expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.076125:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97def expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.076134:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841979.076138:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841979.076141:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df000, rc 0) 00000100:00100000:2.0:1787841979.076243:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:11624:x1874687858673408:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 465us (648us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787841979.076251:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 234 00000100:00100000:2.0:1787841979.086952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841979.087079:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858673536 00000100:00100000:1.0:1787841979.087089:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858673536 00000100:00100000:1.0:1787841979.087150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:1.0:1787841979.087159:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:2349:x1874687858673536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841979.087174:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841979.087197:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e136e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97def expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.087215:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:1.0:1787841979.087220:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841979.087276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:2349:x1874687858673536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 117us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.087299:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:0.0:1787841979.106267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841979.109431:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858673792 00000100:00100000:3.0:1787841979.109449:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858673792 00000100:00100000:2.0:1787841979.109937:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 235 00000100:00100000:2.0:1787841979.109948:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+27:11624:x1874687858673792:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787841979.110040:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110057:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110068:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110240:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110248:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110254:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110260:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dec00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787841979.110264:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110271:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110295:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:2.0:1787841979.110298:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841979.110303:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841979.110309:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dec00/0x1d0ed3605e136e70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841979.110453:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:11624:x1874687858673792:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 506us (4194us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787841979.110474:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 235 00000040:00080000:3.0:1787841979.110608:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841979.110614:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841979.111181:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787841979.111191:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787841979.113916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841979.115752:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674048 00000100:00100000:2.0:1787841979.115777:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674048 00000100:00100000:2.0:1787841979.115834:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:2.0:1787841979.115843:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+28:11624:x1874687858674048:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787841979.116121:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:11624:x1874687858674048:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 278us (2213us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787841979.116128:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 64 00000100:00100000:2.0:1787841979.662536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841979.662581:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841979.662602:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674176 00000100:00100000:0.0:1787841979.662613:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674176 00000100:00100000:2.0:1787841979.662633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841979.662667:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 305 00000100:00100000:2.0:1787841979.662673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841979.662681:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858674176:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841979.662707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841979.662731:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674432 00000100:00100000:2.0:1787841979.662736:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674432 00000100:00100000:2.0:1787841979.662770:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674560 00000100:00100000:2.0:1787841979.662773:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674560 00000100:00100000:0.0:1787841979.662776:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858674176:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.662785:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 305 00000100:00100000:2.0:1787841979.662828:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 100 00000100:00100000:0.0:1787841979.662829:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674688 00000100:00100000:0.0:1787841979.662835:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674688 00000100:00100000:2.0:1787841979.662840:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858674432:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841979.662872:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674304 00000100:00100000:0.0:1787841979.662877:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674304 00000100:00100000:2.0:1787841979.662879:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b98b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858674432:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 42us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841979.662888:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 100 00000100:00100000:0.0:1787841979.662903:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 172 00000100:00100000:2.0:1787841979.662907:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:0.0:1787841979.662916:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858674688:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841979.662922:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fdde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858674560:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841979.663078:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:0.0:1787841979.663084:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5092011a-795a-4dd0-a452-2a019c42720c+5:2347:x1874687858674688:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 169us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.663092:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 172 00000100:00100000:3.0:1787841979.663102:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b99443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:2347:x1874687858674304:12345-192.168.202.46@tcp:400:kworker.0 00000100:00080000:0.0:1787841979.663156:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841979.663161:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841979.674135:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b99443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:2347:x1874687858674304:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 11023us (11440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.674153:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:2.0:1787841979.674350:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fdde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858674560:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 6186us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841979.674366:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 101 00010000:00010000:1.0:1787841979.890043:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841980.914031:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841981.145243:0:12560:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841981.145255:0:12560:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841981.145298:0:12560:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787841981.145305:0:12560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787841981.370011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841981.370158:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858674944 00000100:00100000:3.0:1787841981.370168:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858674944 00000100:00080000:0.0:1787841981.370248:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841981.370250:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 236 00000100:00100000:3.0:1787841981.370264:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+29:11644:x1874687858674944:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1787841981.370285:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841981.370305:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97df6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.370409:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46800/0x1d0ed3605e136e7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.370424:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46800/0x1d0ed3605e136e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.370438:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46800/0x1d0ed3605e136e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841981.370503:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787841981.370651:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97df6 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.370669:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46800/0x1d0ed3605e136e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97df6 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.370679:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:3.0:1787841981.370682:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787841981.370685:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46800, rc 0) 00000100:00100000:3.0:1787841981.370745:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:11644:x1874687858674944:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 485us (744us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787841981.370753:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 236 00000100:00100000:3.0:1787841981.378537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841981.378582:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675072 00000100:00100000:0.0:1787841981.378594:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675072 00000100:00100000:0.0:1787841981.378670:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 237 00000100:00100000:0.0:1787841981.378682:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:11644:x1874687858675072:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:0.0:1787841981.378761:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378782:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378796:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378826:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378833:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378840:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378847:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787841981.378851:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378877:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378890:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:0.0:1787841981.378893:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841981.378898:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.378904:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e136e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841981.378999:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+31:11644:x1874687858675072:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 318us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841981.379007:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 237 00000100:00100000:0.0:1787841981.519395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841981.519517:0:12468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675200 00000100:00100000:3.0:1787841981.519529:0:12468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675200 00000100:00100000:3.0:1787841981.519623:0:12468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00100000:3.0:1787841981.519637:0:12468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858675200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1787841981.519658:0:12468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841981.519682:0:12468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3ae201/0x1d0ed3605e136e93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97dfd expref: -99 pid: 12468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841981.519712:0:12468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a904dba, atime: 0x6a904db9, ctime: 0x6a904dba, blocks: 0xb 00010000:00010000:3.0:1787841981.519735:0:12468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1787841981.519739:0:12468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841981.519750:0:12468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3ae201/0x1d0ed3605e136e93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dfd expref: 8 pid: 12468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.519799:0:12468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb3ae201/0x1d0ed3605e136e93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dfd expref: 8 pid: 12468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.519813:0:12468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47000, rc 0) 00000100:00100000:3.0:1787841981.519884:0:12468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2346:x1874687858675200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 252us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841981.519892:0:12468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 71 00000100:00080000:0.0:1787841981.520498:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841981.530842:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841981.530994:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675328 00000100:00100000:0.0:1787841981.531006:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675328 00002000:00100000:0.0:1787841981.531075:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff94649fddde00 x1874687858675328/t0(0) o3->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:482/0 lens 488/0 e 0 to 0 dl 1787841992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841981.531088:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff94649fddde00 with x1874687858675328 ext(0->4095) 00002000:00010000:0.0:1787841981.531094:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94649fddde00 00000100:00100000:0.0:1787841981.531132:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:0.0:1787841981.531143:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2346:x1874687858675328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1787841981.531508:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+8:2346:x1874687858675328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 314us (625us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787841981.531517:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00002000:00100000:0.0:1787841981.531542:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff94649fddde00 x1874687858675328/t0(0) o3->7142e368-78a3-4f67-bb12-5e4ed629eb65@192.168.202.46@tcp:482/0 lens 488/4536 e 0 to 0 dl 1787841992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841981.531550:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff94649fddde00 with x1874687858675328 ext(0->4095) 00002000:00010000:0.0:1787841981.531553:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94649fddde00 00000100:00100000:1.0:1787841981.681983:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877533184:0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682089:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841981.682160:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787841981.682167:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a7403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877533056:0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682204:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841981.682224:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877533568:0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682251:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841981.682286:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533184 00000100:00100000:1.0:1787841981.682294:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533184 00000100:00100000:1.0:1787841981.682353:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533056 00000100:00100000:1.0:1787841981.682356:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533056 00000100:00100000:1.0:1787841981.682379:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787841981.682388:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877533184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682449:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877533184:12345-0@lo:400:kworker.0 Request processed in 61us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.682490:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787841981.682507:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787841981.682514:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877533056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682539:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877533056:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.682553:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787841981.682587:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533568 00000100:00100000:1.0:1787841981.682591:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533568 00000100:00100000:1.0:1787841981.682619:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787841981.682625:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877533568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682655:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877533568:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.682660:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787841981.682685:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841981.682691:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841981.682721:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a7403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877533056:0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682729:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787841981.682736:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464b99452c0, transno 4294967307 00000004:00080000:1.0:1787841981.682747:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787841981.682768:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464bfbd8780, transno 4294967310 00000100:00100000:1.0:1787841981.682772:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bf905e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877533568:0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.682781:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464932e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877533184:0@lo:400:kworker.0 00000100:00100000:3.0:1787841981.683278:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfbd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877533312:0@lo:400:kworker.0 00000100:00100000:3.0:1787841981.683320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841981.683358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787841981.683364:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648a7412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877532928:0@lo:400:kworker.0 00000100:00100000:3.0:1787841981.683393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841981.683426:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877533440:0@lo:400:kworker.0 00000100:00100000:3.0:1787841981.683494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841981.683814:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533440 00000100:00100000:3.0:1787841981.683821:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533440 00000100:00100000:3.0:1787841981.683873:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787841981.683882:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877533440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841981.683926:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877533440:12345-0@lo:400:kworker.0 Request processed in 45us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841981.683933:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1787841981.683972:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841981.683998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877533440:0@lo:400:kworker.0 00000100:00100000:0.0:1787841981.684250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877532928 00000100:00100000:0.0:1787841981.684256:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877532928 00000100:00100000:1.0:1787841981.684283:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533312 00000100:00100000:1.0:1787841981.684287:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533312 00000100:00100000:0.0:1787841981.684293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787841981.684299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877532928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.684335:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787841981.684338:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877532928:12345-0@lo:400:kworker.0 Request processed in 40us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.684342:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841981.684345:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787841981.684374:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877533312:12345-0@lo:400:kworker.0 Request processed in 33us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841981.684376:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648a7412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877532928:0@lo:400:kworker.0 00000100:00100000:1.0:1787841981.684380:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787841981.684387:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464bfbd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877533312:0@lo:400:kworker.0 00000100:00080000:2.0:1787841981.684545:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787841981.939649:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841982.194112:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841982.194150:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946381cb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877533696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841982.194228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841982.194390:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533696 00000100:00100000:0.0:1787841982.194398:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533696 00000100:00100000:0.0:1787841982.194447:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787841982.194474:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877533696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841982.194509:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841982.194556:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877533696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841982.194563:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787841982.194806:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946381cb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877533696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841982.705809:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877533824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841982.705894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841982.706129:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533824 00000100:00100000:1.0:1787841982.706139:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533824 00000100:00100000:1.0:1787841982.706233:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787841982.706245:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877533824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841982.706286:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841982.706348:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874687877533824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841982.706355:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787841982.706449:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877533824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841982.962198:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787841983.292569:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787841983.292584:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000020:00080000:0.0:1787841983.292855:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1787841983.292871:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:0.0:1787841983.292907:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787841983.292917:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9464851370c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787841983.292922:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394e400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946485137c00 00000020:00080000:0.0:1787841983.292926:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94648394ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9463820d4c00 00000020:00080000:0.0:1787841983.292958:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787841983.293179:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787841983.989249:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841984.786558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841984.786589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841984.786608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841984.786632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841984.786670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841984.786703:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675968 00000100:00100000:0.0:1787841984.786712:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675968 00000100:00100000:0.0:1787841984.786762:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675584 00000100:00100000:0.0:1787841984.786764:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675584 00000100:00100000:0.0:1787841984.786784:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 177 00000100:00100000:0.0:1787841984.786794:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858675968:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841984.786865:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:2346:x1874687858675968:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.786872:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 177 00000100:00100000:0.0:1787841984.786886:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 178 00000100:00100000:0.0:1787841984.786892:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2346:x1874687858675584:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841984.786915:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464867352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2346:x1874687858675584:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 23us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.786933:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 178 00000100:00080000:0.0:1787841984.786960:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841984.787042:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675712 00000100:00100000:0.0:1787841984.787045:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675712 00000100:00100000:0.0:1787841984.787069:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675840 00000100:00100000:0.0:1787841984.787072:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675840 00000100:00100000:0.0:1787841984.787088:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 104 00000100:00100000:0.0:1787841984.787094:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858675712:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841984.787121:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648847ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2346:x1874687858675712:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.787128:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 104 00000100:00100000:0.0:1787841984.787137:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 105 00000100:00100000:0.0:1787841984.787142:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858675840:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841984.787158:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2346:x1874687858675840:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 16us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.787164:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 105 00000100:00080000:0.0:1787841984.787173:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841984.787175:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841984.787333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858675456 00000100:00100000:3.0:1787841984.787338:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858675456 00000100:00100000:3.0:1787841984.787369:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 307 00000100:00100000:3.0:1787841984.787375:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858675456:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.787406:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2346:x1874687858675456:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.787412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 307 00010000:00010000:0.0:1787841985.017825:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841986.034730:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841986.807814:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877533952:0@lo:400:kworker.0 00000100:00100000:2.0:1787841986.807911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841986.810739:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877534208:0@lo:400:kworker.0 00000100:00100000:1.0:1787841986.810823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841986.810867:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841986.810875:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877534080:0@lo:400:kworker.0 00000100:00100000:1.0:1787841986.810907:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841986.811272:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841986.811282:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877534336:0@lo:400:kworker.0 00000100:00100000:2.0:1787841986.811330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841986.811373:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877533952 00000100:00100000:2.0:1787841986.811383:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877533952 00000100:00100000:2.0:1787841986.811439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787841986.811450:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877533952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841986.811538:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877533952:12345-0@lo:400:kworker.0 Request processed in 89us (3627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841986.811560:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787841986.811628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382008780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877533952:0@lo:400:kworker.0 00000100:00100000:0.0:1787841986.812872:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534208 00000100:00100000:0.0:1787841986.812882:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534208 00000100:00100000:0.0:1787841986.812946:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534080 00000100:00100000:0.0:1787841986.812950:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534080 00000100:00100000:0.0:1787841986.812979:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787841986.812988:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877534208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841986.813071:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877534208:12345-0@lo:400:kworker.0 Request processed in 84us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841986.813077:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787841986.813092:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787841986.813105:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877534080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841986.813136:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877534080:12345-0@lo:400:kworker.0 Request processed in 32us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841986.813142:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787841986.813322:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534336 00000100:00100000:1.0:1787841986.813328:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534336 00000100:00100000:1.0:1787841986.813366:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787841986.813373:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877534336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841986.813415:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877534336:12345-0@lo:400:kworker.0 Request processed in 43us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841986.813422:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787841986.813473:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877534080:0@lo:400:kworker.0 00000100:00100000:1.0:1787841986.813487:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877534208:0@lo:400:kworker.0 00000100:00100000:1.0:1787841986.813522:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787841986.813535:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787841986.813552:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877534336:0@lo:400:kworker.0 00000100:00080000:0.0:1787841986.814021:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841986.814028:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841986.815215:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841986.815234:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877534464:0@lo:400:kworker.0 00000100:00100000:3.0:1787841986.815441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841986.815610:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534464 00000100:00100000:2.0:1787841986.815617:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534464 00000100:00100000:2.0:1787841986.815676:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787841986.815685:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877534464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841986.815739:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877534464:12345-0@lo:400:kworker.0 Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841986.815746:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787841986.815817:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787841986.816242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877534592:0@lo:400:kworker.0 00000100:00100000:2.0:1787841986.816279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787841986.818395:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841986.818417:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534592 00000100:00100000:0.0:1787841986.818427:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534592 00000100:00100000:0.0:1787841986.818509:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787841986.818717:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877534592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841986.818841:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877534592:12345-0@lo:400:kworker.0 Request processed in 128us (2559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841986.818848:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787841986.818871:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841986.818963:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877534592:0@lo:400:kworker.0 00010000:00010000:1.0:1787841987.057714:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841987.320713:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841987.330851:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877534720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841987.330938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841987.332114:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534720 00000100:00100000:0.0:1787841987.332127:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534720 00000100:00100000:0.0:1787841987.332197:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787841987.332209:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877534720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841987.332249:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841987.332325:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877534720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841987.332333:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787841987.332572:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382039a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877534720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841987.825878:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841987.825913:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877534848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841987.826024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841987.826186:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534848 00000100:00100000:3.0:1787841987.826194:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534848 00000100:00100000:3.0:1787841987.826247:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787841987.826257:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a72361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877534848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841987.826294:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841987.826354:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a72361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877534848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841987.826522:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877534848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841987.826690:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787841987.980981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841987.982932:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676096 00000100:00100000:2.0:1787841987.982948:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676096 00000100:00100000:2.0:1787841987.983051:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 238 00000100:00100000:2.0:1787841987.983064:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11297:x1874687858676096:12345-192.168.202.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787841987.983183:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11297:x1874687858676096:12345-192.168.202.46@tcp:60:lhsmtool_posix.0 Request processed in 123us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841987.983204:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 238 00000100:00080000:0.0:1787841987.983275:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841987.985665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841987.985799:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676352 00000100:00100000:1.0:1787841987.985809:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676352 00000100:00100000:1.0:1787841987.985870:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 65 00000100:00100000:1.0:1787841987.985881:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:11297:x1874687858676352:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787841987.986418:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:11297:x1874687858676352:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 538us (762us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787841987.986427:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 65 00010000:00010000:1.0:1787841988.081874:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841988.352936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841988.353202:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676480 00000100:00100000:3.0:1787841988.353226:0:8624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676480 00000100:00100000:3.0:1787841988.353306:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 239 00000100:00100000:3.0:1787841988.353317:0:8624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+5:12096:x1874687858676480:12345-192.168.202.46@tcp:101:lsof.0 00010000:00010000:3.0:1787841988.353341:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841988.353365:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46a00/0x1d0ed3605e136e9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e04 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841988.353438:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136ea1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841988.353453:0:8624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841988.353494:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841988.353837:0:8624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787841988.353842:0:8624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841988.353947:0:8624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841988.353977:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46a00/0x1d0ed3605e136e9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e04 expref: 7 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841988.353995:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e04 expref: 6 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841988.354180:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841988.354849:0:8624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:3.0:1787841988.354852:0:8624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841988.354857:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46000, rc 0) 00000100:00100000:2.0:1787841988.355263:0:8624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5092011a-795a-4dd0-a452-2a019c42720c+6:12096:x1874687858676480:12345-192.168.202.46@tcp:101:lsof.0 Request processed in 1944us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841988.355273:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 239 00000020:00080000:1.0:1787841988.407922:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787841988.408112:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787841988.408125:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1787841988.410372:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1787841989.105844:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841989.361839:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841989.361850:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841989.362564:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1787841989.362574:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841989.903778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841989.903831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841989.903880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841989.903914:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841989.903943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841989.903970:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858677120 00000100:00100000:0.0:1787841989.903980:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858677120 00000100:00100000:0.0:1787841989.904032:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676736 00000100:00100000:0.0:1787841989.904047:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676736 00000100:00100000:0.0:1787841989.904084:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 182 00000100:00100000:0.0:1787841989.904095:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+6:2347:x1874687858677120:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841989.904176:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5092011a-795a-4dd0-a452-2a019c42720c+6:2347:x1874687858677120:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 82us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841989.904184:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 182 00000100:00100000:0.0:1787841989.904203:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 183 00000100:00100000:0.0:1787841989.904209:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2347:x1874687858676736:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841989.904238:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2347:x1874687858676736:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841989.904244:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 183 00000100:00100000:0.0:1787841989.904260:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676864 00000100:00100000:0.0:1787841989.904263:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676864 00000100:00100000:0.0:1787841989.904286:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676992 00000100:00100000:0.0:1787841989.904288:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676992 00000100:00100000:0.0:1787841989.904305:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 108 00000100:00100000:0.0:1787841989.904310:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858676864:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841989.904331:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2347:x1874687858676864:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 22us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841989.904357:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 108 00000100:00100000:0.0:1787841989.904367:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 109 00000100:00100000:0.0:1787841989.904372:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858676992:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841989.904392:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2347:x1874687858676992:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 20us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841989.904398:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 109 00000100:00080000:0.0:1787841989.904414:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841989.904418:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841989.904421:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841989.904763:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858676608 00000100:00100000:2.0:1787841989.904768:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858676608 00000100:00100000:2.0:1787841989.904804:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 309 00000100:00100000:2.0:1787841989.904811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858676608:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787841989.904840:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2347:x1874687858676608:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841989.904847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 309 00010000:00010000:1.0:1787841990.129953:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841991.154399:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841991.923813:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638203b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877534976:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.923905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841991.923951:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638203ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877535488:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.923979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841991.924006:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841991.924012:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382039680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877535360:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841991.924067:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638203a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877535104:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841991.924107:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877535616:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841991.924139:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841991.924144:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877535232:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841991.924194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877534976 00000100:00100000:0.0:1787841991.924207:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877534976 00000100:00100000:0.0:1787841991.924255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787841991.924264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877534976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924315:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877534976:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841991.924322:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787841991.924354:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535488 00000100:00100000:0.0:1787841991.924358:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535488 00000100:00100000:0.0:1787841991.924393:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535104 00000100:00100000:0.0:1787841991.924396:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535104 00000100:00100000:0.0:1787841991.924408:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535232 00000100:00100000:0.0:1787841991.924410:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535232 00000100:00100000:0.0:1787841991.924425:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787841991.924430:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877535488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924495:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877535488:12345-0@lo:400:kworker.0 Request processed in 64us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841991.924503:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787841991.924516:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787841991.924521:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877535104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924551:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877535104:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841991.924557:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787841991.924568:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787841991.924574:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877535232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924602:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877535232:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841991.924608:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787841991.924634:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535360 00000100:00100000:0.0:1787841991.924637:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535360 00000100:00100000:0.0:1787841991.924662:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535616 00000100:00100000:0.0:1787841991.924664:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535616 00000100:00100000:0.0:1787841991.924681:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787841991.924687:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877535360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924717:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877535360:12345-0@lo:400:kworker.0 Request processed in 31us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841991.924723:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787841991.924733:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787841991.924738:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924763:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877535616:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841991.924769:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787841991.924816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382039680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877535360:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924826:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638203b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877534976:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924835:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638203ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877535488:0@lo:400:kworker.0 00000100:00080000:0.0:1787841991.924872:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841991.924877:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841991.924879:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841991.924899:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382038f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877535232:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924908:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638203a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877535104:0@lo:400:kworker.0 00000100:00100000:0.0:1787841991.924917:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877535616:0@lo:400:kworker.0 00010000:00010000:1.0:1787841992.177714:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841992.344680:0:12766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:46:31 (1787841991) 00000100:00100000:3.0:1787841992.434728:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841992.434753:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638203a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877535744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841992.434830:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841992.434958:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535744 00000100:00100000:0.0:1787841992.434975:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535744 00000100:00100000:0.0:1787841992.435045:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787841992.435056:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877535744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841992.435099:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841992.435152:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877535744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841992.435160:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787841992.435207:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638203a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877535744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841992.951406:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877535872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841992.951493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841992.951582:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877535872 00000100:00100000:3.0:1787841992.951590:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877535872 00000100:00100000:3.0:1787841992.951633:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787841992.951642:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877535872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841992.951676:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841992.951718:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877535872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841992.951726:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787841992.951954:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877535872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841993.208243:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841994.229420:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841995.043562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841995.043624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841995.043659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841995.043688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841995.043721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841995.043769:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858677632 00000100:00100000:0.0:1787841995.043778:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858677632 00000100:00100000:0.0:1787841995.043852:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858677504 00000100:00100000:0.0:1787841995.043856:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858677504 00000100:00100000:0.0:1787841995.043879:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 112 00000100:00100000:0.0:1787841995.043888:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858677632:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841995.043978:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2349:x1874687858677632:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 91us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841995.043986:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 112 00000100:00100000:0.0:1787841995.044003:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 113 00000100:00100000:0.0:1787841995.044010:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858677504:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841995.044037:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2349:x1874687858677504:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841995.044043:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 113 00000100:00100000:0.0:1787841995.044080:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858677376 00000100:00100000:0.0:1787841995.044084:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858677376 00000100:00100000:0.0:1787841995.044115:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858677760 00000100:00100000:0.0:1787841995.044118:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858677760 00000100:00100000:0.0:1787841995.044140:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 187 00000100:00100000:0.0:1787841995.044147:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2349:x1874687858677376:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841995.044177:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:2349:x1874687858677376:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841995.044183:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 187 00000100:00100000:0.0:1787841995.044195:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 188 00000100:00100000:0.0:1787841995.044201:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2349:x1874687858677760:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787841995.044234:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2349:x1874687858677760:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841995.044240:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 188 00000100:00080000:0.0:1787841995.044256:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841995.044261:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841995.044263:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841995.045033:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858677248 00000100:00100000:1.0:1787841995.045043:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858677248 00000100:00100000:1.0:1787841995.045093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 311 00000100:00100000:1.0:1787841995.045101:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858677248:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787841995.045153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2349:x1874687858677248:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 53us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841995.045175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 311 00010000:00010000:1.0:1787841995.249739:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841996.274771:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841997.045159:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7237c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877536384:0@lo:400:kworker.0 00000100:00100000:2.0:1787841997.045160:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877536256:0@lo:400:kworker.0 00000100:00100000:1.0:1787841997.045244:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7235a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877536128:0@lo:400:kworker.0 00000100:00100000:3.0:1787841997.045250:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7237840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877536000:0@lo:400:kworker.0 00000100:00100000:0.0:1787841997.049565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841997.049698:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536384 00000100:00100000:0.0:1787841997.049708:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536384 00000100:00100000:0.0:1787841997.051295:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787841997.051317:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877536384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841997.051409:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877536384:12345-0@lo:400:kworker.0 Request processed in 103us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841997.051416:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787841997.051447:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841997.051520:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7237c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877536384:0@lo:400:kworker.0 00000100:00100000:2.0:1787841997.052206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841997.052560:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536256 00000100:00100000:0.0:1787841997.052568:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536256 00000100:00080000:2.0:1787841997.052687:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841997.052732:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787841997.052741:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a72352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877536256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841997.052794:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a72352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877536256:12345-0@lo:400:kworker.0 Request processed in 55us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841997.052813:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787841997.052907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877536256:0@lo:400:kworker.0 00000100:00100000:1.0:1787841997.060388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841997.060453:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877536640:0@lo:400:kworker.0 00000100:00100000:1.0:1787841997.060504:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841997.061388:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536640 00000100:00100000:2.0:1787841997.061401:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536640 00000100:00100000:2.0:1787841997.061501:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787841997.061512:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877536640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841997.061602:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877536640:12345-0@lo:400:kworker.0 Request processed in 93us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841997.061622:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787841997.063326:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536128 00000100:00100000:0.0:1787841997.063346:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536128 00000100:00100000:0.0:1787841997.063417:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787841997.063429:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877536128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841997.063556:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877536128:12345-0@lo:400:kworker.0 Request processed in 129us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841997.063564:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1787841997.064717:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841997.064769:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7235a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877536128:0@lo:400:kworker.0 00000100:00100000:1.0:1787841997.064785:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7236580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877536640:0@lo:400:kworker.0 00000100:00100000:3.0:1787841997.070743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841997.070842:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877536512:0@lo:400:kworker.0 00000100:00100000:3.0:1787841997.070883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841997.071038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536000 00000100:00100000:0.0:1787841997.071046:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536000 00000100:00100000:0.0:1787841997.071106:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787841997.071300:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877536000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841997.071371:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648660ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877536000:12345-0@lo:400:kworker.0 Request processed in 257us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841997.071379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787841997.071492:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536512 00000100:00100000:1.0:1787841997.071497:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536512 00000100:00100000:1.0:1787841997.071546:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787841997.071554:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382009e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877536512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841997.071592:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382009e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877536512:12345-0@lo:400:kworker.0 Request processed in 40us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841997.071598:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:2.0:1787841997.071652:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841997.071750:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7237840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877536000:0@lo:400:kworker.0 00000100:00100000:3.0:1787841997.071765:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877536512:0@lo:400:kworker.0 00010000:00010000:2.0:1787841997.299141:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841997.302697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841997.302869:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858678016 00000100:00100000:2.0:1787841997.302881:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858678016 00000100:00100000:2.0:1787841997.302973:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 66 00000100:00100000:2.0:1787841997.302985:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+18:12317:x1874687858678016:12345-192.168.202.46@tcp:35:umount.0 00000100:00100000:2.0:1787841997.303821:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:12317:x1874687858678016:12345-192.168.202.46@tcp:35:umount.0 Request processed in 835us (1132us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787841997.303831:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 66 00000100:00080000:1.0:1787841997.304149:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841997.309097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841997.309739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858678272 00000100:00100000:2.0:1787841997.309750:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858678272 00000100:00100000:2.0:1787841997.309819:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:2.0:1787841997.309831:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+19:12317:x1874687858678272:12345-192.168.202.46@tcp:35:umount.0 00000100:00100000:2.0:1787841997.310296:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:12317:x1874687858678272:12345-192.168.202.46@tcp:35:umount.0 Request processed in 467us (1210us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787841997.310305:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 67 00000100:00100000:3.0:1787841997.319317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841997.319512:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858678528 00000100:00100000:2.0:1787841997.319525:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858678528 00000100:00100000:2.0:1787841997.319681:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 68 00000100:00100000:2.0:1787841997.319694:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464850a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+20:12317:x1874687858678528:12345-192.168.202.46@tcp:35:umount.0 00000100:00100000:2.0:1787841997.320534:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464850a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:12317:x1874687858678528:12345-192.168.202.46@tcp:35:umount.0 Request processed in 837us (1223us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787841997.320556:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 68 00000100:00100000:3.0:1787841997.324303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841997.324622:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858678784 00000100:00100000:0.0:1787841997.324634:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858678784 00000100:00100000:0.0:1787841997.324692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:0.0:1787841997.324701:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:12317:x1874687858678784:12345-192.168.202.46@tcp:35:umount.0 00000100:00100000:0.0:1787841997.325320:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:12317:x1874687858678784:12345-192.168.202.46@tcp:35:umount.0 Request processed in 617us (1026us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787841997.325329:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 69 00000100:00100000:0.0:1787841997.339362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841997.339536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841997.339923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787841997.340400:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858679040 00000100:00100000:1.0:1787841997.340616:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858679040 00000100:00100000:0.0:1787841997.341785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841997.343675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858678912 00000100:00100000:3.0:1787841997.343704:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858678912 00000100:00100000:3.0:1787841997.343850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858679168 00000100:00100000:3.0:1787841997.343855:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858679168 00000100:00100000:3.0:1787841997.343884:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787841997.343893:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+15:2348:x1874687858679040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841997.344142:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841997.344166:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc200/0x1d0ed3605e135e7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97957 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841997.344190:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841997.344958:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+14:2348:x1874687858679040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1061us (5601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841997.344968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787841997.345010:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:3.0:1787841997.345023:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+13:2348:x1874687858678912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841997.345199:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841997.345215:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481499600/0x1d0ed3605e135f19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d9798f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841997.345230:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841997.345264:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:2348:x1874687858678912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 245us (5727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841997.345271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:3.0:1787841997.345287:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:3.0:1787841997.345296:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2348:x1874687858679168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841997.345378:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787841997.345383:0:12468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858679296 00000100:00100000:2.0:1787841997.345391:0:12468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858679296 00010000:00010000:3.0:1787841997.345393:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6df800/0x1d0ed3605e13612d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a5a expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841997.345428:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841997.345449:0:12468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:3.0:1787841997.345546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858679168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 157us (5538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841997.345555:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00080000:3.0:1787841997.345583:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841997.345718:0:12468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2345:x1874687858679296:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1787841997.345743:0:12468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e1361f1 00000100:00080000:2.0:1787841997.345751:0:12468:0:(import.c:65:import_set_state_nolock()) ffff946381279000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787841997.345807:0:12468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787841997.345829:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841997.349822:0:12468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7142e368-78a3-4f67-bb12-5e4ed629eb65+2:2345:x1874687858679296:12345-192.168.202.46@tcp:9:umount.0 Request processed in 4351us (8032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841997.349839:0:12468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 72 00000100:00100000:0.0:1787841997.357933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787841997.358047:0:12012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858679680 00000100:00100000:2.0:1787841997.358058:0:12012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858679680 00000100:00100000:2.0:1787841997.358134:0:12012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 73 00000100:00100000:2.0:1787841997.358145:0:12012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+7:2345:x1874687858679680:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1787841997.358176:0:12012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e136452 00000020:00010000:2.0:1787841997.358184:0:12012:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9464badbf000: total 0 00000100:00080000:2.0:1787841997.358189:0:12012:0:(import.c:65:import_set_state_nolock()) ffff9464bfa17800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787841997.358226:0:12012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787841997.358756:0:12012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7142e368-78a3-4f67-bb12-5e4ed629eb65+5:2345:x1874687858679680:12345-192.168.202.46@tcp:9:umount.0 Request processed in 611us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841997.358765:0:12012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 73 00000020:00010000:1.0:1787841997.358920:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9464badbf000: total 0 00010000:00010000:1.0:1787841997.358953:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9464badbf000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787841997.359038:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066a0d359/0x1d0ed3605e1367f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c2f expref: 4 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.359077:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3ae201/0x1d0ed3605e136e93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97dfd expref: 3 pid: 12468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.359092:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9464badbf000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787841997.359103:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841997.359105:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841997.359107:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787841997.359234:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841997.382228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841997.382508:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858680704 00000100:00100000:0.0:1787841997.382520:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858680704 00000100:00100000:0.0:1787841997.382591:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 240 00000100:00100000:0.0:1787841997.382603:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+22:2345:x1874687858680704:12345-192.168.202.46@tcp:39:umount.0 00000020:00000080:0.0:1787841997.382640:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e8d 00000020:00010000:0.0:1787841997.382657:0:5851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946381fa7800: total 0 00000100:00080000:0.0:1787841997.382663:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9464b9805000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841997.382688:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787841997.383192:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7142e368-78a3-4f67-bb12-5e4ed629eb65+21:2345:x1874687858680704:12345-192.168.202.46@tcp:39:umount.0 Request processed in 589us (974us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787841997.383201:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 240 00000020:00010000:1.0:1787841997.383325:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946381fa7800: total 0 00010000:00010000:1.0:1787841997.383368:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946381fa7800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787841997.383402:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:1.0:1787841997.383406:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841997.383415:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e136b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97d24 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383438:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841997.383441:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841997.383445:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de600/0x1d0ed3605e1366d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97be2 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383504:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841997.383507:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787841997.383512:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfc00/0x1d0ed3605e1361c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a84 expref: 18 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383527:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:1.0:1787841997.383549:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841997.383557:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e136d74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97db0 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383571:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff946487ed3800) 00010000:00010000:1.0:1787841997.383574:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841997.383577:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1364b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97b56 expref: 16 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383596:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648391b200) 00010000:00010000:1.0:1787841997.383598:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787841997.383601:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481200/0x1d0ed3605e136873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c52 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383617:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:1.0:1787841997.383619:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841997.383622:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480400/0x1d0ed3605e136857 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c4b expref: 14 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383632:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648391be00) 00010000:00010000:1.0:1787841997.383634:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841997.383637:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480600/0x1d0ed3605e136173 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a6f expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383648:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841997.383650:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841997.383653:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1367b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c1a expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383676:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:1.0:1787841997.383678:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841997.383681:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e136e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97de8 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383692:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946487ed3a00) 00010000:00010000:1.0:1787841997.383695:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787841997.383698:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46800/0x1d0ed3605e136e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97df6 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383712:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9464999d2500) 00010000:00010000:1.0:1787841997.383714:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841997.383717:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e136157 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a68 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383732:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff946487ed3c00) 00010000:00010000:1.0:1787841997.383734:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787841997.383738:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480a00/0x1d0ed3605e1367e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97c28 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841997.383752:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946381fa7800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787841997.383765:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841997.383767:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841997.383769:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841997.553937:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877536768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841997.554046:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841997.554327:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536768 00000100:00100000:3.0:1787841997.554343:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536768 00000100:00100000:3.0:1787841997.554416:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787841997.554427:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7234780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877536768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841997.554498:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841997.554564:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7234780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877536768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841997.554572:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787841997.554817:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877536768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841998.066541:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841998.066566:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877536896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841998.066636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841998.066822:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877536896 00000100:00100000:3.0:1787841998.066829:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877536896 00000100:00100000:3.0:1787841998.066896:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787841998.066906:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877536896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841998.066945:0:6696:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841998.066994:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877536896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841998.067008:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787841998.067238:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877536896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841998.325122:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787841998.635101:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000001:00080000:1.0:1787841998.635124:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787841998.635141:0:5871:0:(genops.c:885:class_export_put()) final put ffff946381fa7800/7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:0.0:1787841998.635269:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946381fa7800/7142e368-78a3-4f67-bb12-5e4ed629eb65 for lustre-MDT0000 00000020:00000080:0.0:1787841998.635443:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464b9805000 for lustre-MDT0000 00000001:00100000:0.0:1787841998.674344:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:0.0:1787841998.674355:0:6718:0:(genops.c:885:class_export_put()) final put ffff9464badbf000/7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:1.0:1787841998.674502:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9464badbf000/7142e368-78a3-4f67-bb12-5e4ed629eb65 for lustre-OST0000 00000020:00000080:1.0:1787841998.674561:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464bfa17800 for lustre-OST0000 00000001:00100000:3.0:1787841999.176014:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:3.0:1787841999.176025:0:7646:0:(genops.c:885:class_export_put()) final put ffff946381279800/7142e368-78a3-4f67-bb12-5e4ed629eb65 00000020:00000080:0.0:1787841999.176109:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946381279800/7142e368-78a3-4f67-bb12-5e4ed629eb65 for lustre-OST0001 00000020:00000080:0.0:1787841999.176179:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946381279000 for lustre-OST0001 00010000:00010000:3.0:1787841999.345818:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787841999.602036:0:11686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841999.602046:0:11686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841999.602347:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787841999.602356:0:11686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787841999.910508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841999.910560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841999.910592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841999.910621:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787841999.910654:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858680832 00000100:00100000:3.0:1787841999.910666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858680832 00000100:00100000:3.0:1787841999.910730:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858681088 00000100:00100000:3.0:1787841999.910733:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858681088 00000100:00100000:3.0:1787841999.910745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858680960 00000100:00100000:3.0:1787841999.910748:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858680960 00000100:00100000:3.0:1787841999.910767:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:3.0:1787841999.910793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+12:2348:x1874687858680832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841999.910816:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841999.910843:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946481499c00/0x1d0ed3605e135f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979a4 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841999.910870:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841999.910939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+11:2348:x1874687858680832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 151us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841999.910947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:3.0:1787841999.910967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:3.0:1787841999.910974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+10:2348:x1874687858681088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841999.910983:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841999.911662:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc000/0x1d0ed3605e136126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97a53 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841999.911680:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841999.911718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+9:2348:x1874687858681088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 743us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841999.911725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:3.0:1787841999.911746:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:3.0:1787841999.911755:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+8:2348:x1874687858680960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841999.911765:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841999.911786:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481800/0x1d0ed3605e135f66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d979ce expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841999.911797:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841999.911816:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+7:2348:x1874687858680960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841999.911822:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:1.0:1787841999.912674:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858681344 00000100:00100000:1.0:1787841999.912687:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858681344 00000100:00100000:1.0:1787841999.912750:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 241 00000100:00100000:1.0:1787841999.912760:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+6:2345:x1874687858681344:12345-192.168.202.46@tcp:39:umount.0 00000020:00000080:1.0:1787841999.912808:0:5849:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135f74 00000020:00010000:1.0:1787841999.912816:0:5849:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946381fa3000: total 0 00000100:00080000:1.0:1787841999.912820:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9464b7fc7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787841999.912850:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1787841999.913083:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946381fa3000: total 0 00010000:00010000:2.0:1787841999.913126:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946381fa3000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787841999.913171:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391bf00) 00010000:00010000:2.0:1787841999.913175:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841999.913182:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c46000/0x1d0ed3605e136ea1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e04 expref: 5 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841999.913214:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946381fa3000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787841999.913227:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841999.913229:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841999.913231:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787841999.913292:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841999.913765:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5092011a-795a-4dd0-a452-2a019c42720c+3:2345:x1874687858681344:12345-192.168.202.46@tcp:39:umount.0 Request processed in 1004us (3322us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787841999.913786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 241 00000100:00100000:2.0:1787841999.948196:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787841999.948309:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858681600 00000100:00100000:0.0:1787841999.948334:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858681600 00000100:00100000:0.0:1787841999.948388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 313 00000100:00100000:0.0:1787841999.948398:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+7:2345:x1874687858681600:12345-192.168.202.46@tcp:251:umount.0 00000020:00000080:0.0:1787841999.948498:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e6a 00000020:00010000:0.0:1787841999.948507:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946381fa6800: total 0 00000100:00080000:0.0:1787841999.948513:0:5841:0:(import.c:65:import_set_state_nolock()) ffff946381fa5000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787841999.948590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ec827ec-b678-4253-8ad7-a0e8fdbfe846+3:2345:x1874687858681600:12345-192.168.202.46@tcp:251:umount.0 Request processed in 193us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841999.948597:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 313 00000020:00010000:1.0:1787841999.948794:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946381fa6800: total 0 00010000:00010000:1.0:1787841999.948800:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841999.948846:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946381fa6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787841999.948886:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481e00/0x1d0ed3605e135f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97996 expref: 2 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841999.948903:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946381fa6800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787841999.948915:0:7632:0:(genops.c:885:class_export_put()) final put ffff946381fa6800/3ec827ec-b678-4253-8ad7-a0e8fdbfe846 00010000:00010000:1.0:1787841999.948938:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841999.948941:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841999.948944:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787841999.949193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946381fa6800/3ec827ec-b678-4253-8ad7-a0e8fdbfe846 for MGS 00000020:00000080:0.0:1787841999.949236:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946381fa5000 for MGS 00010000:00010000:0.0:1787842000.373255:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842001.401338:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787842002.158042:0:12968:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:3.0:1787842002.168982:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382008f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877537280:0@lo:400:kworker.0 00000100:00100000:3.0:1787842002.169090:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842002.169163:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787842002.169170:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877537152:0@lo:400:kworker.0 00000100:00100000:3.0:1787842002.169196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842002.170741:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b99452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877537664:0@lo:400:kworker.0 00000100:00100000:3.0:1787842002.170810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842002.170902:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877537408:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.170933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842002.170961:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787842002.170968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877537024:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.170997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842002.171039:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94648537a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877537536:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.171067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842002.175731:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537280 00000100:00100000:3.0:1787842002.175747:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537280 00000100:00100000:3.0:1787842002.175838:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537152 00000100:00100000:3.0:1787842002.175842:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537152 00000100:00100000:3.0:1787842002.175856:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537536 00000100:00100000:3.0:1787842002.175859:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537536 00000100:00100000:3.0:1787842002.175879:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787842002.175888:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877537280:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787842002.181905:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787842002.182017:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877537280:12345-0@lo:400:kworker.0 Request processed in 6123us (12919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842002.182031:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787842002.182079:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787842002.182101:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877537152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842002.182184:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877537152:12345-0@lo:400:kworker.0 Request processed in 97us (12988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842002.182192:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787842002.182205:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787842002.182225:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877537536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842002.182261:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874687877537536:12345-0@lo:400:kworker.0 Request processed in 39us (11194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842002.182266:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787842002.184201:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877537152:0@lo:400:kworker.0 00000100:00100000:3.0:1787842002.184235:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382008f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877537280:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.187981:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537664 00000100:00100000:0.0:1787842002.188003:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537664 00000100:00100000:0.0:1787842002.188078:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537408 00000100:00100000:0.0:1787842002.188082:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537408 00000100:00100000:0.0:1787842002.188113:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787842002.188124:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877537664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.188246:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877537664:12345-0@lo:400:kworker.0 Request processed in 123us (17435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842002.188269:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787842002.188519:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787842002.188527:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877537408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.188564:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877537408:12345-0@lo:400:kworker.0 Request processed in 38us (17630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842002.188570:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787842002.188594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537024 00000100:00100000:0.0:1787842002.188598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537024 00000100:00100000:0.0:1787842002.188624:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787842002.188631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877537024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.188662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:907da169-f099-4269-9458-b15bc87a550d+19:3306:x1874687877537024:12345-0@lo:400:kworker.0 Request processed in 32us (17665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842002.188668:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:0.0:1787842002.188706:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787842002.188710:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787842002.188761:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b99452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877537664:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.188799:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:907da169-f099-4269-9458-b15bc87a550d:3306:1874687877537024:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.188812:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94648537a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1874687877537536:0@lo:400:kworker.0 00000100:00100000:0.0:1787842002.188822:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877537408:0@lo:400:kworker.0 00000020:01000004:2.0:1787842002.190176:0:12968:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787842002.191489:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.191509:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.191517:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.191523:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.191547:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787842002.191551:0:12968:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787842002.191582:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787842002.191588:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787842002.191594:0:12968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787842002.191638:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9464870fa000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787842002.191707:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877537792:0@lo:39:umount.0 00000100:00100000:0.0:1787842002.191779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842002.191860:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537792 00000100:00100000:2.0:1787842002.191866:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537792 00000100:00100000:2.0:1787842002.191913:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787842002.191921:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874687877537792:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787842002.191947:0:5850:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c79 00000100:00080000:2.0:1787842002.191955:0:5850:0:(import.c:65:import_set_state_nolock()) ffff9464b9644800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787842002.192005:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1874687877537792:12345-0@lo:39:umount.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842002.192012:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787842002.192020:0:5850:0:(genops.c:885:class_export_put()) final put ffff94649c2b3000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1787842002.192093:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464870fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787842002.192108:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877537792:0@lo:39:umount.0 00010000:00010000:1.0:1787842002.192191:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842002.192199:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.192208:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787842002.192284:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.192294:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787842002.192302:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842002.192308:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787842002.192311:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787842002.192314:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787842002.192345:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.192352:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787842002.192447:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.192473:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481499e00/0x1d0ed3605e135eef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135ef6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.192486:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842002.192488:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842002.192490:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842002.192496:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842002.192501:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787842002.192518:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877537920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.192557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842002.192594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877537920 00000100:00100000:1.0:1787842002.192598:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877537920 00000100:00100000:1.0:1787842002.192631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787842002.192637:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464870da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+19:3308:x1874687877537920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842002.192648:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842002.192664:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2044c00/0x1d0ed3605e135ef6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135eef expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.192678:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842002.192702:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464870da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907da169-f099-4269-9458-b15bc87a550d+18:3308:x1874687877537920:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842002.192709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787842002.192775:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877537920:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787842002.192895:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787842002.192899:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787842002.192903:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787842002.193536:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94649c2b3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787842002.193601:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464b9644800 for lustre-MDT0000 00010000:00010000:2.0:1787842002.195680:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195699:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195706:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195713:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195733:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842002.195740:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195774:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195781:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195787:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195801:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787842002.195807:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195813:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195819:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195825:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195839:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787842002.195845:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195851:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195867:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195874:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842002.195887:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787842002.195890:0:12968:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787842002.195916:0:12968:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787842002.195920:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787842002.195924:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842002.195931:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1787842002.195938:0:12968:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9463825da000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787842002.195944:0:12968:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9464b9641800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787842002.195951:0:12968:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff946381fa3000 5092011a-795a-4dd0-a452-2a019c42720c 192.168.202.46@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787842002.195956:0:12968:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9464870b1a48) has exports, disconnecting them 00000020:00080000:2.0:1787842002.195961:0:12968:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9463825da000), last request at 1787842002 00000020:00000080:2.0:1787842002.195968:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135dec 00000100:00080000:2.0:1787842002.195988:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9463825dc800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787842002.196195:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787842002.196204:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842002.196212:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787842002.196215:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842002.196225:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787842002.196232:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842002.196238:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787842002.196240:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787842002.196243:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787842002.196281:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842002.196288:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787842002.196313:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842002.196320:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464c2045e00/0x1d0ed3605e135efd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135f04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.199795:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787842002.199817:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.199833:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dda00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787842002.199838:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.199852:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787842002.199860:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842002.199893:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787842002.199896:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787842002.199899:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787842002.199951:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.199957:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787842002.199972:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.199979:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dda00/0x1d0ed3605e135e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135e2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200000:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787842002.200005:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200010:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd800 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787842002.200013:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200019:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787842002.200026:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842002.200032:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787842002.200034:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787842002.200036:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787842002.200057:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200063:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787842002.200093:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200100:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dd800/0x1d0ed3605e136118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e13611f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200110:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842002.200114:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200119:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787842002.200122:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200129:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787842002.200135:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842002.200141:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787842002.200143:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787842002.200145:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787842002.200157:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200163:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787842002.200168:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200183:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481498e00/0x1d0ed3605e135bd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135bdf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.200196:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842002.200197:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842002.200199:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842002.201343:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877538176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.201616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842002.201685:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787842002.201693:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877538048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.201716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842002.201768:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877538176 00000100:00100000:1.0:1787842002.201776:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877538176 00000100:00100000:1.0:1787842002.201825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877538048 00000100:00100000:1.0:1787842002.201829:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877538048 00000100:00100000:1.0:1787842002.201847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787842002.201855:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+19:3307:x1874687877538176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842002.201873:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842002.201894:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dc800/0x1d0ed3605e135e2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135e24 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.201916:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842002.201952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+18:3307:x1874687877538176:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842002.201959:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787842002.201975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787842002.201981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+17:3307:x1874687877538048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842002.202003:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842002.202012:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480031a00/0x1d0ed3605e135f04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135efd expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.202022:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842002.202044:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+16:3307:x1874687877538048:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842002.202050:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787842002.202088:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877538048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.202097:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877538176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.202121:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877538304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.202144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842002.202161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787842002.202167:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877538432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842002.202184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842002.202202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877538304 00000100:00100000:1.0:1787842002.202205:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877538304 00000020:00080000:2.0:1787842002.202316:0:12968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9463825da000): rc 0 00000020:00000080:2.0:1787842002.202323:0:12968:0:(genops.c:885:class_export_put()) final put ffff9463825da000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787842002.202338:0:12968:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9464b9641800), last request at 1787842002 00000020:00000080:2.0:1787842002.202346:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135d21 00000100:00080000:2.0:1787842002.202358:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9464b9645800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787842002.202393:0:12968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9464b9641800): rc 0 00000020:00000080:2.0:1787842002.202395:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464b9641800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787842002.202404:0:12968:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb8cac1c8bae0 00000100:00080000:2.0:1787842002.202431:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787842002.202434:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787842002.202468:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787842002.202531:0:12968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787842002.202548:0:12968:0:(import.c:65:import_set_state_nolock()) ffff946487c57000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787842002.202564:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787842002.202567:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787842002.202576:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787842002.202649:0:12968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787842002.202658:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9464bf97a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787842002.202687:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9464870b1a48) has no exports 00000100:00100000:1.0:1787842002.203589:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877538432 00000100:00100000:1.0:1787842002.203596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877538432 00000100:00100000:1.0:1787842002.203618:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787842002.203627:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+17:3308:x1874687877538304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842002.203639:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842002.203655:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6df400/0x1d0ed3605e13611f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e136118 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842002.203671:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842002.203736:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+16:3308:x1874687877538304:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842002.203744:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787842002.203774:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787842002.203781:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+15:3308:x1874687877538432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842002.203789:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842002.203798:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2045200/0x1d0ed3605e135bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135bd8 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842002.206966:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877538304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787842002.206997:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842002.207011:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842002.207037:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842002.209761:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842002.209868:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:907da169-f099-4269-9458-b15bc87a550d+14:3308:x1874687877538432:12345-0@lo:103:ldlm_bl.0 Request processed in 6081us (7676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842002.209883:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787842002.210078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:907da169-f099-4269-9458-b15bc87a550d:3308:1874687877538432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842002.210389:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842002.210407:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842002.210409:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787842002.210424:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9463825da000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787842002.215580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b9641800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787842002.215656:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9463825dc800 for lustre-MDT0000 00000020:00000080:0.0:1787842002.215662:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464b9645800 for lustre-MDT0000 00000100:00100000:0.0:1787842002.215688:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7236940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877538560:0@lo:9:umount.0 00000100:00100000:0.0:1787842002.215796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842002.215851:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877538688:0@lo:9:umount.0 00000100:00100000:0.0:1787842002.215876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842002.215945:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877538560 00000100:00100000:0.0:1787842002.215956:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877538560 00000100:00100000:0.0:1787842002.216006:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877538688 00000100:00100000:0.0:1787842002.216009:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877538688 00000100:00100000:0.0:1787842002.216033:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787842002.216042:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874687877538560:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787842002.216075:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135d6e 00000100:00080000:0.0:1787842002.216087:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9464bfa15000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787842002.216126:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787842002.216411:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787842002.216422:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874687877538688:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787842002.216436:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e55 00000100:00080000:2.0:1787842002.216443:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9463827d6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787842002.216509:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787842002.216884:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1874687877538688:12345-0@lo:9:umount.0 Request processed in 463us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842002.216895:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787842002.217574:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842002.217894:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3305:x1874687877538560:12345-0@lo:9:umount.0 Request processed in 1849us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842002.217902:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787842002.217961:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946487c57000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787842002.217981:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787842002.217983:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787842002.217987:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7236940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877538560:0@lo:9:umount.0 00000100:00080000:0.0:1787842002.218002:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464bf97a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787842002.218019:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787842002.218036:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787842002.218040:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877538688:0@lo:9:umount.0 00010000:00010000:0.0:1787842002.218071:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787842002.224223:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9464870b1a48) has no exports 00000020:00000080:2.0:1787842002.307339:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c33 00000020:00000080:2.0:1787842002.307356:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464b9640800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787842002.307380:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787842002.307548:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787842002.307574:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787842002.307578:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff946484e63490) has no exports 00000020:00000080:1.0:1787842002.307743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b9640800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787842002.308850:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c2c 00000020:00000080:3.0:1787842002.308860:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464badbc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787842002.308955:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787842002.308965:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787842002.308968:0:12968:0:(genops.c:885:class_export_put()) final put ffff94649c187000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787842002.308971:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff94649c187000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787842002.308976:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787842002.309168:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464badbc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787842002.417706:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842003.443797:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787842003.807938:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787842003.807948:0:6718:0:(genops.c:885:class_export_put()) final put ffff9464bfa13800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787842003.807978:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bfa13800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787842003.808021:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464bfa15000 for lustre-OST0000 00000001:00100000:1.0:1787842003.817888:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5092011a-795a-4dd0-a452-2a019c42720c 00000001:00080000:1.0:1787842003.817906:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787842003.817912:0:5871:0:(genops.c:885:class_export_put()) final put ffff946381fa3000/5092011a-795a-4dd0-a452-2a019c42720c 00000020:00000080:2.0:1787842003.818141:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946381fa3000/5092011a-795a-4dd0-a452-2a019c42720c for lustre-MDT0000 00000020:00000080:2.0:1787842003.818213:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464b7fc7000 for lustre-MDT0000 00000001:00100000:2.0:1787842004.265348:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787842004.265355:0:7646:0:(genops.c:885:class_export_put()) final put ffff9463827d5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787842004.265377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9463827d5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787842004.265412:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9463827d6800 for lustre-OST0001 00000020:01000000:3.0:1787842004.337620:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff946487048a20 - data ffff9464ab36f948/ffff94649fe79400 00000020:01000000:3.0:1787842004.337815:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9464871891e0 - data ffff9464ae3aae58/ffff9464b9144c00 00000001:00000004:3.0:1787842004.352927:0:12968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1787842004.467524:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787842004.508452:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787842004.508497:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787842004.508523:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787842004.508526:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787842004.510111:0:6923:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787842004.510119:0:6923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787842004.510129:0:6923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787842004.515234:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787842004.515244:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787842004.515270:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787842004.515273:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787842004.517559:0:8035:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787842004.517568:0:8035:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787842004.517582:0:8035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787842004.611144:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135bfb 00000020:00000080:2.0:1787842004.611157:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464b990f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787842004.613085:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c10 00000020:00000080:2.0:1787842004.613097:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464870fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787842004.614975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b990f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787842004.615129:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787842004.615142:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842004.615153:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787842004.615158:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9464870b0000) has no exports 00000020:00000080:0.0:1787842004.615933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464870fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787842004.616127:0:12968:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787842004.616138:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e4e 00000020:00000080:2.0:1787842004.616147:0:12968:0:(genops.c:885:class_export_put()) final put ffff9463827d7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787842004.616447:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787842004.616479:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842004.616490:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787842004.616494:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9463826db490) has no exports 00000020:00000080:2.0:1787842004.616503:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135e47 00000020:00000080:2.0:1787842004.616517:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464bf97a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787842004.617018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9463827d7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787842004.617144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bf97a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787842004.617930:0:12968:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787842004.617936:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787842004.617940:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787842004.617946:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787842004.617949:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787842004.618039:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842004.618052:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787842004.618060:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135d67 00000020:00000080:2.0:1787842004.618070:0:12968:0:(genops.c:885:class_export_put()) final put ffff94638125e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787842004.618440:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464bf97a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787842004.618447:0:8:0:(genops.c:885:class_export_put()) final put ffff946381fa6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787842004.618450:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946381fa6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787842004.618660:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787842004.618825:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787842004.618833:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842004.618840:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787842004.618845:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff946487c1ced8) has no exports 00000020:00000080:2.0:1787842004.618854:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135d60 00000020:00000080:2.0:1787842004.618860:0:12968:0:(genops.c:885:class_export_put()) final put ffff946487c52800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787842004.619151:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94638125e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787842004.619159:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946487c52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787842004.619323:0:12968:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787842004.619327:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787842004.619331:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787842004.619440:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787842004.619443:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787842004.619677:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842004.619684:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787842004.619716:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842004.619720:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787842004.619734:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464b990f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787842004.619738:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b990f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787842004.619746:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787842004.619898:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c17 00000020:00000080:2.0:1787842004.619903:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464870ff000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787842004.620565:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946487c57000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787842004.620575:0:8:0:(genops.c:885:class_export_put()) final put ffff9464c1af1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787842004.620578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464c1af1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787842004.620583:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787842004.620751:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787842004.620764:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842004.620770:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787842004.620774:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9464870b4ed8) has no exports 00000020:00000080:2.0:1787842004.620797:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842004.620801:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787842004.620806:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c1e 00000020:00000080:2.0:1787842004.620810:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464870f8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787842004.620819:0:12968:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946485cca000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787842004.620823:0:12968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946485cca000 3 00000020:01000004:2.0:1787842004.620826:0:12968:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946485cca000 from lustre-MDT0000 00000020:00000080:2.0:1787842004.620862:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842004.620867:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787842004.620869:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464b990d000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787842004.620871:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b990d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787842004.620886:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787842004.620925:0:12968:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787842004.620929:0:12968:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787842004.620932:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787842004.620935:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842004.620937:0:12968:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787842004.620951:0:12968:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9464835e4000 907da169-f099-4269-9458-b15bc87a550d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787842004.620958:0:12968:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9464871a1a48) has exports, disconnecting them 00000020:00080000:2.0:1787842004.620963:0:12968:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9464835e4000), last request at 1787841748 00000020:00000080:2.0:1787842004.620977:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135bbc 00000020:00010000:2.0:1787842004.620989:0:12968:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9464835e4000: total 2 00000100:00080000:2.0:1787842004.620993:0:12968:0:(import.c:65:import_set_state_nolock()) ffff946491788000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787842004.621064:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464870ff000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787842004.621069:0:8:0:(genops.c:885:class_export_put()) final put ffff9464b990e000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787842004.621071:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464b990e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787842004.621076:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787842004.621300:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464870f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1787842004.621530:0:12968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9464835e4000): rc 0 00000020:00080000:2.0:1787842004.621535:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9464871a1a48) has no exports 00000100:00100000:2.0:1787842004.621597:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff946486600200:5844] 2 exiting: rc = 0 00000100:00100000:0.0:1787842004.621760:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff946486600000:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1787842004.621817:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff946485dcbe00:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1787842004.622686:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622694:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622700:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622715:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622721:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622739:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622746:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622751:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622756:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622763:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622768:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622774:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622780:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622786:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622792:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622797:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622804:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622809:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622815:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622820:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622826:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622832:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622838:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622843:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622849:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622856:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622862:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622867:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622872:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622879:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622884:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622889:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622895:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622901:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622906:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622912:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622916:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622922:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622934:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622940:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622945:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622950:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622955:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622960:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622966:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622971:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622976:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622981:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622988:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622993:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.622998:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623003:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623007:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623012:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623016:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623021:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623026:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623032:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623037:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623042:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623048:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623055:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623084:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842004.623103:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787842004.624191:0:12968:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787842004.624197:0:12968:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:1.0:1787842004.625588:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9464835e4000: total 0 00010000:00010000:1.0:1787842004.625651:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9464835e4000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787842004.625685:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481400/0x1d0ed3605e135ecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135ec5 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625702:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2045400/0x1d0ed3605e135eda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135ed3 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625744:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7247600/0x1d0ed3605e136103 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e1360fc expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625754:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2044600/0x1d0ed3605e135ee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135ee1 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625764:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2044200/0x1d0ed3605e135f12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135f0b expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625772:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464829dcc00/0x1d0ed3605e136111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e13610a expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625788:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2045800/0x1d0ed3605e135cd4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135ccd expref: 3 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625801:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480c00/0x1d0ed3605e135ebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1d0ed3605e135eb7 expref: 2 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842004.625812:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9464835e4000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787842004.625825:0:7632:0:(genops.c:885:class_export_put()) final put ffff9464835e4000/907da169-f099-4269-9458-b15bc87a550d 00010000:00010000:1.0:1787842004.625847:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842004.625849:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842004.625851:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787842004.625923:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9464835e4000/907da169-f099-4269-9458-b15bc87a550d for MGS 00000020:00000080:0.0:1787842004.625990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946491788000 for MGS 00000020:01000000:2.0:1787842004.626241:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9464b982e3c0 - data ffff9464bfc7b0d8/ffff9464b9816000 00000020:01000000:2.0:1787842004.626426:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9464835ebf00 - data ffff9464ae3d8510/ffff946485d72800 00000020:00000080:2.0:1787842004.627049:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135ba0 00000020:00000080:2.0:1787842004.627057:0:12968:0:(genops.c:885:class_export_put()) final put ffff94648554c000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787842004.627075:0:12968:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946485cca000 from MGS, refs=2 00000020:01000004:2.0:1787842004.627079:0:12968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946485cca000 2 00000020:01000004:2.0:1787842004.627094:0:12968:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946485cca000 from MGS 00000020:00000080:2.0:1787842004.627119:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842004.627128:0:12968:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787842004.627131:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464916cc800/MGS 00000020:00000080:2.0:1787842004.627133:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff9464916cc800/MGS for MGS 00000020:01000000:2.0:1787842004.627139:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787842004.627198:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787842004.627203:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842004.627208:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787842004.627217:0:12968:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9464870fa800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787842004.627223:0:12968:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9464870b3490) has exports, disconnecting them 00000020:00080000:2.0:1787842004.627227:0:12968:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9464870fa800), last request at 1787841749 00000020:00000080:2.0:1787842004.627233:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135c6b 00000020:00080000:2.0:1787842004.627243:0:12968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9464870fa800): rc 0 00000020:00000080:2.0:1787842004.627248:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464870fa800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787842004.627978:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94648554c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787842004.627993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464870fa800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787842004.630549:0:12968:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787842004.630560:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787842004.630565:0:12968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787842004.630581:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787842004.630809:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842004.630819:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787842004.630827:0:12968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946485cca000 1 00000020:00000080:0.0:1787842004.630834:0:12968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135b92 00000020:00000080:0.0:1787842004.630844:0:12968:0:(genops.c:885:class_export_put()) final put ffff9464916ce000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787842004.630850:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787842004.630855:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787842004.630859:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787842004.630871:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff946484e64ed8) has no exports 00000020:00000080:1.0:1787842004.632920:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9464870fa000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787842004.632934:0:37:0:(genops.c:885:class_export_put()) final put ffff9464870ff800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787842004.632938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464870ff800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787842004.632949:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787842004.633021:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464916ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787842004.666802:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842004.666817:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787842004.666824:0:12968:0:(genops.c:885:class_export_put()) final put ffff946485cce000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787842004.666828:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff946485cce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787842004.666835:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787842004.666971:0:12968:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff946485cc8000 00000020:01000000:0.0:1787842004.666994:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787842004.666998:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787842004.667003:0:12968:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787842004.667007:0:12968:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9464871a3490) has no exports 00000100:00100000:0.0:1787842004.667207:0:8624:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9464b980bc00:8624] 3 exiting: rc = 0 00000100:00100000:0.0:1787842004.667348:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff946487dd4a00:5851] 2 exiting: rc = 0 00000100:00100000:2.0:1787842004.669281:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff94648a78aa00:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1787842004.670586:0:5849:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff946487dd4800:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787842004.670674:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670682:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670688:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670693:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670712:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670718:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670738:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670744:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670750:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670755:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670760:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670766:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670771:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670777:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670783:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670793:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670799:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670805:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670810:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670817:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670822:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670827:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670833:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670839:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670844:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670849:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670855:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670860:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670866:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670871:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670877:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670882:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670888:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670893:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670899:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670903:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670908:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670913:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670919:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670932:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670937:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670943:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670950:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670955:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670961:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670966:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670971:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670978:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670982:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670987:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670993:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.670998:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671004:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671009:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671015:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671021:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671026:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671030:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671035:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671041:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671045:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671051:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671057:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.671062:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842004.680223:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff946487dd4400:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1787842004.680592:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff94648a78a400:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1787842004.680670:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680679:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680685:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680691:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680697:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680703:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680710:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680716:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680722:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680751:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680756:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680762:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680768:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680772:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680777:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680782:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680787:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680791:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680797:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680802:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680808:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680813:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680818:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680823:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680828:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680834:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680840:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680844:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680848:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680853:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680859:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680864:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680869:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680874:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680879:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680883:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680888:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680893:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680897:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680902:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680907:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680913:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680917:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680922:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680934:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680939:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680945:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680949:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680954:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680959:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680964:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680969:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680973:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680978:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680983:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680987:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680992:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.680997:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681001:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681006:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681011:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681015:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681020:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681024:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.681742:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9464850b4600:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1787842004.681862:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9464850b4800:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1787842004.682000:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682018:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682027:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682032:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682038:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682044:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682065:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682074:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682082:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682145:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682153:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682158:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682163:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682170:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682189:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682196:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682203:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682212:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682235:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682243:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682249:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682256:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682263:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682269:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682558:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682565:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682572:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682579:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682584:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682590:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682612:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682621:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682627:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682633:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682640:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682646:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682652:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682658:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682665:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682670:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682677:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682683:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682703:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682711:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682717:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682734:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682741:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682749:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682755:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682769:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682775:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682781:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682788:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682794:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682815:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682823:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682830:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682837:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682843:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682851:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682856:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682862:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682868:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.682874:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842004.697526:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9464850b4400:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1787842004.700662:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9464850b5200:5857] 1 exiting: rc = 0 00000100:00100000:0.0:1787842004.702254:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702263:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702269:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702275:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702282:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702287:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702293:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702298:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702304:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702309:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702314:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702320:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702325:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702331:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702584:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702593:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702599:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702604:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702610:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702615:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702633:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702638:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702644:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702649:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702654:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702660:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702665:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702670:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702675:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702680:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702685:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702690:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702696:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702702:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702707:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702713:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702718:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702734:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702741:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702746:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702751:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702756:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702762:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702767:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702773:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702778:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702783:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702788:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702793:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702798:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702803:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702808:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702813:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702818:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702825:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702838:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702843:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702849:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702854:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702859:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702864:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702870:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702875:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.702880:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842004.708026:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9464850b0e00:5859] 1 exiting: rc = 0 00000100:00100000:2.0:1787842004.712684:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9464850b1000:5858] 0 exiting: rc = 1 00000100:00100000:0.0:1787842004.712921:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712930:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712936:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712940:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712946:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712952:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712956:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712962:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712967:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712972:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712977:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712981:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712986:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712990:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.712995:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713000:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713006:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713010:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713015:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713020:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713025:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713030:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713035:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713040:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713044:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713049:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713066:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713071:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713076:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713081:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713085:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713090:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713095:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713100:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713107:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713111:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713116:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713121:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713126:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713130:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713135:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713140:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713145:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713150:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713154:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713159:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713164:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713169:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713174:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713179:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713184:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713189:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713194:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713199:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713205:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713210:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713215:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713221:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713226:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713231:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713235:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713248:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713252:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.713257:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842004.713800:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff94648842ba00:5861] 1 exiting: rc = 0 00000100:00100000:2.0:1787842004.715059:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9464850b0200:5860] 0 exiting: rc = 1 00000100:00100000:0.0:1787842004.715220:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715227:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715232:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715238:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715243:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715248:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715254:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715258:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715263:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715267:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715272:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715278:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715283:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715288:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715293:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715298:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715302:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715307:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715312:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715317:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715322:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715328:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715333:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715354:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715360:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715365:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715369:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715374:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715379:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715384:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715389:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715394:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715412:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715418:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715423:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715429:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715434:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715439:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715445:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715450:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715477:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715483:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715487:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715492:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715498:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715503:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715508:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715513:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715518:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715522:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715527:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715532:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715537:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715543:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715548:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715553:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715558:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715563:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715568:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715573:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715577:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715583:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715587:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.715593:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.716366:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff94648842a800:5863] 1 exiting: rc = 0 00000100:00100000:0.0:1787842004.716658:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9464850b0600:5864] 2 exiting: rc = 0 00000100:00100000:3.0:1787842004.718430:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff94648842a600:5862] 0 exiting: rc = 1 00000100:00100000:0.0:1787842004.718919:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718939:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718946:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718952:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718958:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718964:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718970:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718978:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718984:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718990:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.718996:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719001:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719007:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719027:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719035:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719040:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719046:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719051:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719057:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719062:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719069:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719075:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719082:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719088:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719093:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719099:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719105:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719111:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719117:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719123:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719128:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719134:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719140:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719145:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719151:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719157:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719170:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719192:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719199:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719206:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719212:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719219:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719224:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719231:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719237:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719244:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719250:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719256:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719263:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719269:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719276:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719281:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719287:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719293:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719299:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719308:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719314:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719320:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719327:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719333:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719354:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719360:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719366:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842004.719383:0:12968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787842004.724028:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842004.724042:0:12968:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787842004.724048:0:12968:0:(genops.c:885:class_export_put()) final put ffff946487d18800/MDS_uuid 00000020:00000080:0.0:1787842004.724054:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff946487d18800/MDS_uuid for MDS 00000020:01000000:0.0:1787842004.724064:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787842004.724224:0:12968:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787842005.490730:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842006.513630:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787842007.284983:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877538944:0@lo:400:kworker.0 00000400:00000100:3.0:1787842007.285039:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877538944 offset 0 length 224: 4 00000100:00100000:3.0:1787842007.285102:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787842007.285107:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877538816:0@lo:400:kworker.0 00000400:00000100:3.0:1787842007.285123:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874687877538816 offset 0 length 224: 4 00000100:00100000:3.0:1787842007.285145:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787842007.285152:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877539072:0@lo:400:kworker.0 00000400:00000100:3.0:1787842007.285166:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877539072 offset 0 length 224: 4 00010000:00010000:0.0:1787842007.545371:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787842008.472433:0:13122:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787842008.490499:0:13122:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787842008.490553:0:13122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842008.490570:0:13122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842008.490588:0:13122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842008.490597:0:13122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842008.490621:0:13122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787842008.490626:0:13122:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787842008.491742:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842008.491753:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842008.491763:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787842008.491768:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842008.491776:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787842008.491784:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842008.491789:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787842008.491792:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787842008.491795:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787842008.491839:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842008.491845:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787842008.491877:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842008.491884:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481498400/0x1d0ed3605e135ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1d0ed3605e135eda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842008.491898:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842008.491899:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842008.491901:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787842008.492157:0:13122:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787842008.492171:0:13122:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94638291d680 x1874687877538944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787842008.492191:0:13122:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787842008.492197:0:13122:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787842008.492212:0:13122:0:(import.c:65:import_set_state_nolock()) ffff94638127a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787842008.492281:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877539200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787842008.492400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874687877539328:0@lo:39:umount.0 00000400:00000100:0.0:1787842008.492506:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877539328 offset 0 length 224: 4 00000100:00100000:2.0:1787842008.492766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842008.492922:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877538944:0@lo:400:kworker.0 00000100:00100000:1.0:1787842008.493004:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877539200 00000100:00100000:1.0:1787842008.493019:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877539200 00000100:00100000:1.0:1787842008.493067:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787842008.493075:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7235680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1874687877539200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787842008.493083:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787842008 with bad export cookie 2093843287622507452 00000100:00100000:1.0:1787842008.502125:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7235680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1874687877539200:12345-0@lo:103:ldlm_bl.0 Request processed in 9043us (9354us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787842008.502140:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787842008.502240:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787842008.502247:0:3309:0:(import.c:65:import_set_state_nolock()) ffff946487d1e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787842008.502252:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787842008.509855:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.146@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787842008.509861:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787842008.509871:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94638291cf00 x1874687877538816/t0(0) o400->MGC192.168.202.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787842023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842008.509946:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9464884c6580 x1874687877539200/t0(0) o103->MGC192.168.202.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787842024 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787842008.509956:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787842008.509959:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787842008.509961:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787842008.509964:0:3309:0:(import.c:65:import_set_state_nolock()) ffff946487d1e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787842008.509969:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.202.146@tcp: connect to NID 0@lo last attempt 137 00000100:00080000:3.0:1787842008.509979:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.202.146@tcp: import ffff946487d1e800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:2.0:1787842008.510149:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464a7236d00 x1874687877539456/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787842008.510199:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:907da169-f099-4269-9458-b15bc87a550d:3309:1874687877539200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787842008.510261:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7236d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:907da169-f099-4269-9458-b15bc87a550d:3305:1874687877539456:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1787842008.510332:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874687877539456 offset 0 length 520: 4 00000100:00100000:0.0:1787842008.512450:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:907da169-f099-4269-9458-b15bc87a550d:3307:1874687877538816:0@lo:400:kworker.0 00010000:00010000:0.0:1787842008.563894:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842009.586900:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842010.609682:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842011.633915:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787842012.403868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787842012.403880:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787842012.404094:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787842012.404125:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877539584:0@lo:400:kworker.0 00000400:00000100:3.0:1787842012.404196:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877539584 offset 0 length 224: 4 00010000:00010000:0.0:1787842012.657714:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787842013.425803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787842013.425815:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787842013.425969:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877539712:0@lo:400:kworker.0 00000400:00000100:0.0:1787842013.426030:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877539712 offset 0 length 224: 4 00010000:00010000:1.0:1787842013.682984:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842014.706785:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842015.729782:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842016.753718:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842017.777882:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842018.034146:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842008/real 1787842008] req@ffff9464a7236d00 x1874687877539456/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787842018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842018.034179:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9464a7236d00 x1874687877539456/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787842018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842018.034191:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842008/real 1787842008] req@ffff94638291e1c0 x1874687877539328/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787842018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842018.034214:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94638291e1c0 x1874687877539328/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787842018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787842018.034239:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946487d1e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787842018.034269:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787842018.034273:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7236d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:907da169-f099-4269-9458-b15bc87a550d:3305:1874687877539456:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787842018.034304:0:3305:0:(import.c:65:import_set_state_nolock()) ffff94638127a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787842018.034326:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874687877539328:0@lo:39:umount.0 00000100:00080000:1.0:1787842018.034440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787842018.034445:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787842018.034447:0:36:0:(import.c:65:import_set_state_nolock()) ffff946487d1e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787842018.034452:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.146@tcp: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1787842018.034492:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.146@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787842018.034500:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.146@tcp: import ffff946487d1e800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:1.0:1787842018.034530:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638291e580 x1874687877539840/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787842018.034639:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877539968:0@lo:400:kworker.0 00000400:00000100:1.0:1787842018.034694:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877539968 offset 0 length 224: 4 00000100:00100000:2.0:1787842018.034844:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:907da169-f099-4269-9458-b15bc87a550d:3305:1874687877539840:0@lo:250:kworker.0 00000400:00000100:2.0:1787842018.034880:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874687877539840 offset 0 length 520: 4 00000100:00080000:3.0:1787842018.035426:0:13122:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787842018.035432:0:13122:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787842018.035437:0:13122:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787842018.036439:0:13122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036484:0:13122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036511:0:13122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036520:0:13122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036546:0:13122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787842018.036555:0:13122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036562:0:13122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036568:0:13122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036574:0:13122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842018.036604:0:13122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787842018.036609:0:13122:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787842018.036634:0:13122:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787842018.036638:0:13122:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787842018.036643:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787842018.036649:0:13122:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787842018.036653:0:13122:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9464bfa2ced8) has no exports 00000020:00080000:3.0:1787842018.036678:0:13122:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9464bfa2ced8) has no exports 00000020:01000000:3.0:1787842018.038430:0:13122:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94649e7fed20 - data ffff9464ab2e6bd0/ffff94649fe7e000 00010000:00010000:2.0:1787842018.038818:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787842018.038842:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842018.038865:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481499200 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842018.038870:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842018.038880:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842018.038887:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842018.038893:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787842018.038896:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787842018.038900:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787842018.038920:0:7632:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:2.0:1787842018.038924:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842018.038931:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481499200/0x1d0ed3605e135ee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135ee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842018.039277:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842018.039284:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842018.039292:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787842018.039295:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842018.039301:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787842018.039308:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842018.039314:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787842018.039316:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787842018.039318:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787842018.039327:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:0.0:1787842018.039329:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842018.039335:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464a7246e00/0x1d0ed3605e13610a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e136111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842018.044473:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842018.044481:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842018.044484:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842018.046543:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842018.046548:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842018.046551:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787842018.046686:0:13122:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff946491658300 - data ffff9464ae3eeaf8/ffff9464bf9c1400 00100000:10000000:3.0:1787842018.055569:0:13122:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787842018.092164:0:13122:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135cf0 00000020:00000080:2.0:1787842018.092174:0:13122:0:(genops.c:885:class_export_put()) final put ffff9464bfa12800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787842018.092190:0:13122:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946486706000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787842018.092194:0:13122:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946486706000 2 00000020:01000004:2.0:1787842018.092198:0:13122:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946486706000 from lustre-OST0000 00000020:00000080:2.0:1787842018.092245:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842018.092254:0:13122:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787842018.092257:0:13122:0:(genops.c:885:class_export_put()) final put ffff9464bfa15800/lustre-OST0000_UUID 00000020:00000080:2.0:1787842018.092260:0:13122:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bfa15800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787842018.092266:0:13122:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787842018.092340:0:13122:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787842018.092345:0:13122:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787842018.092348:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842018.092353:0:13122:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787842018.092359:0:13122:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94638125a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787842018.092365:0:13122:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9464bfa2b490) has exports, disconnecting them 00000020:00080000:2.0:1787842018.092370:0:13122:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94638125a000), last request at 1787841767 00000020:00000080:2.0:1787842018.092373:0:13122:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135d1a 00000020:00080000:2.0:1787842018.092382:0:13122:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94638125a000): rc 0 00000020:00000080:2.0:1787842018.092395:0:13122:0:(genops.c:885:class_export_put()) final put ffff94638125a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787842018.093547:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bfa12800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787842018.093597:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94638125a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787842018.122661:0:13122:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787842018.122672:0:13122:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787842018.122678:0:13122:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787842018.122688:0:13122:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787842018.122940:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94638127a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787842018.126042:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842018.126057:0:13122:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787842018.126063:0:13122:0:(genops.c:885:class_export_put()) final put ffff9464bfa13000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787842018.126068:0:13122:0:(genops.c:844:class_export_destroy()) destroying export ffff9464bfa13000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787842018.126080:0:13122:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787842018.126158:0:13122:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946486706000 1 00000020:00000080:2.0:1787842018.126165:0:13122:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135caa 00000020:00000080:2.0:1787842018.126172:0:13122:0:(genops.c:885:class_export_put()) final put ffff9464871c2800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787842018.126187:0:13122:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787842018.126192:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842018.126197:0:13122:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787842018.126386:0:13122:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff946484e60000) has no exports 00000020:00000080:0.0:1787842018.126976:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9464871c2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787842018.162386:0:13122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842018.162411:0:13122:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787842018.162419:0:13122:0:(genops.c:885:class_export_put()) final put ffff946486707800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787842018.162425:0:13122:0:(genops.c:844:class_export_destroy()) destroying export ffff946486707800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787842018.162447:0:13122:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787842018.162688:0:13122:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff946486701800 00000020:02000400:2.0:1787842018.162758:0:13122:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787842018.801714:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842019.825858:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842020.854428:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787842021.380757:0:13272:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787842021.391797:0:13272:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787842021.391887:0:13272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842021.391901:0:13272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842021.391909:0:13272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842021.391915:0:13272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842021.391979:0:13272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787842021.391984:0:13272:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787842021.392004:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787842021.392016:0:13272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94638291c000 x1874687877539072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842021.392035:0:13272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9464884c52c0 x1874687877539584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842028 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842021.392055:0:13272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94638226f480 x1874687877539712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842021.392063:0:13272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94638291c3c0 x1874687877539968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842021.392084:0:13272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787842021.392089:0:13272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787842021.392115:0:13272:0:(import.c:65:import_set_state_nolock()) ffff946381fa4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787842021.392209:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877539712:0@lo:400:kworker.0 00000100:00100000:3.0:1787842021.392219:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877539584:0@lo:400:kworker.0 00000100:00100000:1.0:1787842021.392332:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877539072:0@lo:400:kworker.0 00000100:00100000:1.0:1787842021.392360:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877539968:0@lo:400:kworker.0 00010000:00010000:2.0:1787842021.392414:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842021.392422:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842021.392429:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030a00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842021.392433:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842021.392442:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842021.392450:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842021.392588:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787842021.392591:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787842021.392594:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787842021.392609:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:2.0:1787842021.392614:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842021.392622:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946480030a00/0x1d0ed3605e135eb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135ebe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842021.392648:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842021.392650:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842021.392652:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842021.392669:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874687877540096:0@lo:39:umount.0 00000400:00000100:2.0:1787842021.392723:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687877540096 offset 0 length 224: 4 00010000:00010000:0.0:1787842021.874040:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842022.898055:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787842023.155756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787842023.155766:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787842023.924585:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842024.955572:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842025.970956:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842026.993709:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842028.019858:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787842028.273576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787842028.273586:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 907da169-f099-4269-9458-b15bc87a550d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787842029.041829:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842030.067047:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842031.089744:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842031.601594:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842021/real 1787842021] req@ffff9464884c5680 x1874687877540096/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787842031 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787842031.601628:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9464884c5680 x1874687877540096/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787842031 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787842031.601648:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946381fa4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787842031.601669:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874687877540096:0@lo:39:umount.0 00000100:00080000:0.0:1787842031.601955:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787842031.601961:0:13272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787842031.601965:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787842031.604577:0:13272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604601:0:13272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604611:0:13272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604618:0:13272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604669:0:13272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842031.604678:0:13272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604685:0:13272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604691:0:13272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604698:0:13272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.604718:0:13272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787842031.604722:0:13272:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787842031.604743:0:13272:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787842031.604747:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787842031.604751:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787842031.604757:0:13272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787842031.604761:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9464bfa28000) has no exports 00000020:00080000:0.0:1787842031.604788:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9464bfa28000) has no exports 00010000:00010000:2.0:1787842031.604841:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787842031.604849:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604857:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946481498600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842031.604861:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604870:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842031.604877:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842031.604890:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787842031.604892:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787842031.604895:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787842031.604908:0:7632:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:2.0:1787842031.604912:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604918:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481498600/0x1d0ed3605e135ec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135ecc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604933:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842031.604937:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604942:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464829dd600 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842031.604945:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604952:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842031.604958:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842031.604963:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787842031.604965:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787842031.604967:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787842031.604970:0:7632:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:2.0:1787842031.604972:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604983:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829dd600/0x1d0ed3605e1360fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e136103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842031.604996:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842031.604998:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842031.605000:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842031.605227:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787842031.606765:0:13272:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94649e7feb40 - data ffff9464ab2e6ca8/ffff94649fe7d400 00000020:01000000:0.0:1787842031.606971:0:13272:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff946489248f00 - data ffff9464bfc0fbd0/ffff9464bfa1a400 00100000:10000000:0.0:1787842031.614076:0:13272:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787842031.624783:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135dbb 00000020:00000080:0.0:1787842031.624793:0:13272:0:(genops.c:885:class_export_put()) final put ffff94638127c800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787842031.624804:0:13272:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9464c1af7000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787842031.624807:0:13272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9464c1af7000 2 00000020:01000004:0.0:1787842031.624810:0:13272:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9464c1af7000 from lustre-OST0001 00000020:00000080:0.0:1787842031.624844:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842031.624855:0:13272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787842031.624858:0:13272:0:(genops.c:885:class_export_put()) final put ffff946381278000/lustre-OST0001_UUID 00000020:00000080:0.0:1787842031.624862:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff946381278000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787842031.624869:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787842031.624933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94638127c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1787842031.624986:0:13272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 907da169-f099-4269-9458-b15bc87a550d->MGS 00010000:00010000:0.0:1787842031.625010:0:13272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787842031.625022:0:13272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842031.625030:0:13272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787842031.625033:0:13272:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787842031.625037:0:13272:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787842031.625055:0:13272:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:0.0:1787842031.625060:0:13272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff9464829ddc00/0x1d0ed3605e135ccd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135cd4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842031.625075:0:13272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787842031.625082:0:13272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842031.625087:0:13272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787842031.625089:0:13272:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787842031.625091:0:13272:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787842031.625102:0:13272:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946487d1e800 00010000:00010000:0.0:1787842031.625105:0:13272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946481499400/0x1d0ed3605e135f0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1d0ed3605e135f12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787842031.625133:0:13272:0:(import.c:65:import_set_state_nolock()) ffff946487d1e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787842031.625137:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787842031.625140:0:13272:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787842031.625141:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787842031.625150:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787842031.625162:0:13272:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94638291e580 x1874687877539840/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787842033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787842031.625183:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787842031.625186:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1787842031.625222:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:907da169-f099-4269-9458-b15bc87a550d:3305:1874687877539840:0@lo:250:kworker.0 10000000:01000000:0.0:1787842031.625240:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787842031.625246:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135bae 00000020:00000080:0.0:1787842031.625251:0:13272:0:(genops.c:885:class_export_put()) final put ffff946487d1b000/907da169-f099-4269-9458-b15bc87a550d 00000020:01000000:0.0:1787842031.625267:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.146@tcp (flags='') 00000020:00000080:2.0:1787842031.625275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946487d1b000/907da169-f099-4269-9458-b15bc87a550d for MGC192.168.202.146@tcp 00000020:00000080:0.0:1787842031.625283:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787842031.625288:0:13272:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.146@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787842031.625292:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9464871a4ed8) has no exports 10000000:01000000:3.0:1787842031.625431:0:5847:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787842031.625551:0:13272:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.146@tcp: client import never connected 00000100:00080000:0.0:1787842031.625555:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787842031.625556:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787842031.625559:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787842031.625561:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787842031.625597:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946487d1e800 for MGC192.168.202.146@tcp 00000020:00000080:0.0:1787842031.625600:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842031.625605:0:13272:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.146@tcp (uuid 907da169-f099-4269-9458-b15bc87a550d) 00000020:00000080:0.0:1787842031.625608:0:13272:0:(genops.c:885:class_export_put()) final put ffff946487d1b800/907da169-f099-4269-9458-b15bc87a550d 00000020:00000080:0.0:1787842031.625610:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff946487d1b800/907da169-f099-4269-9458-b15bc87a550d for MGC192.168.202.146@tcp 00000020:01000000:0.0:1787842031.625614:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.146@tcp (907da169-f099-4269-9458-b15bc87a550d) 00000020:01000000:0.0:1787842031.625890:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787842031.625894:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787842031.625899:0:13272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787842031.625904:0:13272:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9463827d1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787842031.625916:0:13272:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9463826dced8) has exports, disconnecting them 00000020:00080000:0.0:1787842031.625921:0:13272:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9463827d1000), last request at 1787841788 00000020:00000080:0.0:1787842031.625925:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135de5 00000020:00080000:0.0:1787842031.625935:0:13272:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9463827d1000): rc 0 00000020:00000080:0.0:1787842031.625939:0:13272:0:(genops.c:885:class_export_put()) final put ffff9463827d1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787842031.625965:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9463827d1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787842031.628570:0:13272:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787842031.628582:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787842031.628587:0:13272:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787842031.628594:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787842031.628662:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787842031.628754:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946381fa4000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787842031.629152:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787842031.629434:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1787842031.629578:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1787842031.629718:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff946483915800:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1787842031.630846:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff946483915200:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1787842031.630970:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631189:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff946483914200:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1787842031.631189:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff946487c99a00:5836] 2 exiting: rc = 0 00000100:00100000:3.0:1787842031.631275:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff946487c98200:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1787842031.631431:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631436:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631440:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631445:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631448:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631452:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631487:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631493:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631499:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631505:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631523:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631529:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631535:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631541:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631548:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631554:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631561:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631567:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631572:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631576:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631580:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631584:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631587:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631591:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631595:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631599:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631603:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631606:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631609:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631612:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631615:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631618:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631623:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631626:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631629:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631633:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631636:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631639:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631642:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631646:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631650:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631653:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631656:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631659:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631663:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631672:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631676:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631679:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631683:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631686:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631690:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631693:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631696:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631699:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631703:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631706:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631709:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631719:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631723:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631726:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631729:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631732:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631735:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787842031.631739:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787842031.632450:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787842031.632516:0:13272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787842031.632524:0:13272:0:(genops.c:885:class_export_put()) final put ffff946381fa0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787842031.632528:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff946381fa0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787842031.632535:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787842031.632576:0:13272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9464c1af7000 1 00000020:00000080:2.0:1787842031.632580:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1d0ed3605e135d8a 00000020:00000080:2.0:1787842031.632585:0:13272:0:(genops.c:885:class_export_put()) final put ffff946487c51800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787842031.632688:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787842031.632692:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787842031.632697:0:13272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787842031.632701:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff946484e61a48) has no exports 00000020:00000080:3.0:1787842031.632999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946487c51800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787842031.641520:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842031.641541:0:13272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787842031.641547:0:13272:0:(genops.c:885:class_export_put()) final put ffff9464c009e800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787842031.641553:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff9464c009e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787842031.641561:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787842031.641743:0:13272:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9464c1af2000 00000020:01000000:0.0:1787842031.641766:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787842031.641770:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787842031.641775:0:13272:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787842031.641779:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9464871a0000) has no exports 00000020:00000080:0.0:1787842031.641806:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787842031.641813:0:13272:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787842031.641816:0:13272:0:(genops.c:885:class_export_put()) final put ffff9464871c4800/OSS_uuid 00000020:00000080:0.0:1787842031.641818:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff9464871c4800/OSS_uuid for OSS 00000020:01000000:0.0:1787842031.641822:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787842031.641899:0:5845:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787842031.641908:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff94648668ac00:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1787842031.642007:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff946485594e00:6694] 2 exiting: rc = 0 00000100:00100000:0.0:1787842031.642055:0:12012:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff94649035d800:12012] 3 exiting: rc = 0 00000100:00100000:1.0:1787842031.642134:0:12468:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9464b9892800:12468] 4 exiting: rc = 0 00000100:00100000:2.0:1787842031.644704:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff946483959800:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1787842031.644776:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644786:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644792:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644800:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644805:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644811:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644835:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644839:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644844:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644849:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644855:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644861:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644866:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644871:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644876:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644881:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644887:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644892:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644897:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644903:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644908:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644914:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644919:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644924:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644929:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644935:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644942:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644947:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644952:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644958:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644962:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644967:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644972:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644977:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644983:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644988:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644993:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.644999:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645004:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645010:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645016:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645028:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645033:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645039:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645044:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645049:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645054:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645059:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645064:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645069:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645073:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645078:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645082:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645087:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645091:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645096:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645101:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645106:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645114:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645121:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645127:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645132:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645137:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.645142:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787842031.645982:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94649035c800:6695] 0 exiting: rc = 1 00000100:00100000:2.0:1787842031.646132:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94649035ca00:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1787842031.646177:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646184:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646189:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646195:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646201:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646206:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646211:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646216:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646221:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646227:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646232:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646237:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646249:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646254:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646260:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646265:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646269:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646273:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646276:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646280:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646283:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646286:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646289:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646292:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646295:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646298:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646301:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646305:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646307:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646310:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646313:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646316:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646319:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646322:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646325:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646328:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646331:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646334:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646337:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646340:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646344:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646350:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646355:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646359:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646364:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646369:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646374:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646386:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646391:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646396:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646401:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646406:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646410:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646413:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646416:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646420:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646423:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646427:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646431:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646434:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646437:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646440:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646443:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.646447:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787842031.647407:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff946485594800:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1787842031.647700:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff946485594200:6699] 2 exiting: rc = 0 00000100:00100000:1.0:1787842031.647915:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94649035d200:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1787842031.647959:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647966:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647972:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647978:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647982:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647987:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647993:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.647998:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648003:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648009:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648014:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648020:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648025:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648031:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648037:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648051:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648059:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648064:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648081:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648086:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648091:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648096:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648102:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648108:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648113:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648119:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648124:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648130:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648134:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648139:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648144:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648150:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648155:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648161:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648167:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648173:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648178:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648184:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648189:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648209:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648215:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648221:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648227:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648231:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648236:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648242:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648247:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648252:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648258:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648264:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648269:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648274:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648279:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648291:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648296:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648301:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648307:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648312:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648317:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648323:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648328:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648333:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648339:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787842031.648344:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.653858:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff946485595a00:6701] 1 exiting: rc = 0 00000100:00100000:1.0:1787842031.655831:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff946485594a00:6700] 0 exiting: rc = 1 00000100:00100000:1.0:1787842031.655929:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655936:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655941:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655946:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655950:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655955:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655959:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655963:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655968:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655972:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655976:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655982:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655986:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655990:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.655995:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656000:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656004:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656008:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656013:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656017:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656021:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656025:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656029:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656033:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656037:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656041:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656045:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656049:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656053:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656057:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656235:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656240:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656244:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656248:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656254:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656259:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656266:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656271:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656280:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656286:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656293:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656305:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656313:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656320:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656326:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656332:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656339:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656347:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656352:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656359:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656365:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656369:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656373:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656377:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656381:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656385:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656389:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656393:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656398:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656402:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656406:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656409:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656413:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.656417:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657268:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9464980eda00:6702] 0 exiting: rc = 1 00000100:00100000:1.0:1787842031.657337:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9464980ed400:6703] 1 exiting: rc = 0 00000100:00100000:1.0:1787842031.657373:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657379:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657393:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657399:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657404:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657410:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657415:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657420:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657426:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657433:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657438:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657443:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657448:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657485:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657504:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657510:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657516:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657521:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657527:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657532:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657537:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657543:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657548:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657554:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657558:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657563:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657580:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657586:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657591:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657596:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657601:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657607:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657612:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657617:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657629:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657634:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657639:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657645:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657660:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657666:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657671:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657676:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657681:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657686:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657691:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657700:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657707:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657714:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657719:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657725:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657741:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657747:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657754:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657759:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657764:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657769:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657774:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657779:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657784:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657789:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657794:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657800:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.657815:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787842031.660541:0:13272:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787842031.680656:0:13272:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787842051.024001:0:13889:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787842061.794336:0:14350:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787842061.794341:0:14350:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787842061.794558:0:14350:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9464bfa16800 00000020:01000004:3.0:1787842061.794574:0:14350:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787842061.794582:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787842061.794595:0:14350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9464bfa29a48) 00000020:00000080:3.0:1787842061.794608:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787842061.809895:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787842061.812224:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787842061.812908:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 535: rc = 0 00100000:10000000:3.0:1787842061.813117:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787842061.813198:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 535: rc = 0 00100000:10000000:3.0:1787842061.813300:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 535: rc = 0 00100000:10000000:3.0:1787842061.813399:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 535: rc = 0 00100000:10000000:2.0:1787842061.815802:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 535: rc = 0 00100000:10000000:2.0:1787842061.815920:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 535: rc = 0 00100000:10000000:2.0:1787842061.816224:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 640: rc = 0 00100000:10000000:2.0:1787842061.817271:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 540: rc = 0 00100000:10000000:2.0:1787842061.817378:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 540: rc = 0 00100000:10000000:2.0:1787842061.817813:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 782: rc = 0 00100000:10000000:2.0:1787842061.818228:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 782: rc = 0 00100000:10000000:2.0:1787842061.818512:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 782: rc = 0 00100000:10000000:2.0:1787842061.818815:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 782: rc = 0 00100000:10000000:2.0:1787842061.819070:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 782: rc = 0 00100000:10000000:2.0:1787842061.820094:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 782: rc = 0 00100000:10000000:2.0:1787842061.820355:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 782: rc = 0 00100000:10000000:2.0:1787842061.820795:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 782: rc = 0 00100000:10000000:2.0:1787842061.821038:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 782: rc = 0 00100000:10000000:2.0:1787842061.821351:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 782: rc = 0 00100000:10000000:2.0:1787842061.821710:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 782: rc = 0 00100000:10000000:2.0:1787842061.821973:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 782: rc = 0 00100000:10000000:2.0:1787842061.822786:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 801: rc = 0 00100000:10000000:2.0:1787842061.823043:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 801: rc = 0 00100000:10000000:2.0:1787842061.823368:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 801: rc = 0 00100000:10000000:2.0:1787842061.823997:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 801: rc = 0 00100000:10000000:2.0:1787842061.824359:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 801: rc = 0 00100000:10000000:2.0:1787842061.824719:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 801: rc = 0 00100000:10000000:2.0:1787842061.824976:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 801: rc = 0 00100000:10000000:2.0:1787842061.825752:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 801: rc = 0 00100000:10000000:2.0:1787842061.826014:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 801: rc = 0 00100000:10000000:2.0:1787842061.830741:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 801: rc = 0 00100000:10000000:2.0:1787842061.831040:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 801: rc = 0 00100000:10000000:2.0:1787842061.831331:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 801: rc = 0 00100000:10000000:3.0:1787842061.832114:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 801: rc = 0 00100000:10000000:3.0:1787842061.832402:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 801: rc = 0 00100000:10000000:3.0:1787842061.832929:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 801: rc = 0 00100000:10000000:3.0:1787842061.833265:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 801: rc = 0 00100000:10000000:3.0:1787842061.833700:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 801: rc = 0 00100000:10000000:3.0:1787842061.833973:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 801: rc = 0 00100000:10000000:3.0:1787842061.834355:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 801: rc = 0 00100000:10000000:3.0:1787842061.834722:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 801: rc = 0 00100000:10000000:3.0:1787842061.834974:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 801: rc = 0 00100000:10000000:3.0:1787842061.835351:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 801: rc = 0 00100000:10000000:3.0:1787842061.835778:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 801: rc = 0 00100000:10000000:3.0:1787842061.836033:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 801: rc = 0 00100000:10000000:3.0:1787842061.836566:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 801: rc = 0 00100000:10000000:3.0:1787842061.836837:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 801: rc = 0 00100000:10000000:3.0:1787842061.837091:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 801: rc = 0 00100000:10000000:3.0:1787842061.837358:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 801: rc = 0 00100000:10000000:3.0:1787842061.837788:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 801: rc = 0 00100000:10000000:3.0:1787842061.838056:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 801: rc = 0 00100000:10000000:3.0:1787842061.838330:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 801: rc = 0 00100000:10000000:3.0:1787842061.845903:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 801: rc = 0 00100000:10000000:3.0:1787842061.846652:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 790: rc = 0 00100000:10000000:3.0:1787842061.847172:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787842061.847353:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 541: rc = 0 00100000:10000000:3.0:1787842061.847649:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787842061.847717:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 541: rc = 0 00100000:10000000:3.0:1787842061.847998:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787842061.848076:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 541: rc = 0 00100000:10000000:3.0:1787842061.848510:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787842061.848579:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 52: rc = 0 00100000:10000000:3.0:1787842061.848762:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787842061.848826:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 52: rc = 0 00100000:10000000:3.0:1787842061.849012:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787842061.849066:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 52: rc = 0 00000020:00000080:3.0:1787842061.849346:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787842061.849355:0:14350:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787842061.849366:0:14350:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136eaf 00000020:01000004:3.0:1787842061.849374:0:14350:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787842061.849379:0:14350:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787842061.849385:0:14350:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464bfa16800 from MGS 00000020:01000004:3.0:1787842061.849388:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787842061.849397:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9464bfa28000) 00000020:00000080:3.0:1787842061.849405:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787842061.849454:0:14350:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464bfa16800 from MGS, refs=2 00080000:01000000:3.0:1787842061.849481:0:14350:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787842061.849486:0:14350:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136ebd 00000100:00100000:3.0:1787842061.849574:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787842061.849694:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787842061.849699:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787842061.850199:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787842061.850205:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787842061.850913:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842061.851104:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787842061.851109:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787842061.851619:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787842061.851625:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787842061.851874:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787842061.851879:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787842061.852355:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842061.852359:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842061.852361:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842061.852912:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842061.852915:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842061.852923:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842061.853400:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787842061.859534:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787842061.863033:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787842061.863053:0:14350:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787842061.863056:0:14350:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787842061.864725:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787842061.864873:0:14350:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787842061.864967:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787842061.865610:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787842061.865914:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787842061.866072:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787842061.866079:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787842061.874882:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787842061.874924:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787842061.877027:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787842061.877040:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787842061.878091:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787842061.878115:0:14350:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.146@tcp' 00000020:01000004:2.0:1787842061.878117:0:14350:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787842061.878150:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.146@tcp (typ=mgc) 00000020:00000080:2.0:1787842061.878176:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.146@tcp (ffff9463826dced8) 00000020:00000080:2.0:1787842061.878195:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787842061.878277:0:14350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946383a67000@MGC192.168.202.146@tcp: add connection 192.168.202.146@tcp at head 00010000:00010000:2.0:1787842061.878451:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.146@tcp-0 is initialized 00000040:01000000:2.0:1787842061.878484:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787842061.880560:0:14364:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787842061.882841:0:14366:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787842061.883359:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.146@tcp (uuid a5153086-f7d7-4317-94f4-d9c880bce3b9) 00000020:00000080:2.0:1787842061.883391:0:14350:0:(genops.c:1385:class_connect()) connect: client a5153086-f7d7-4317-94f4-d9c880bce3b9, cookie 0x1d0ed3605e136ecb 00000100:00080000:2.0:1787842061.883405:0:14350:0:(import.c:510:import_select_connection()) MGC192.168.202.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787842061.883413:0:14350:0:(import.c:624:import_select_connection()) MGC192.168.202.146@tcp: import ffff946383a67000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:2.0:1787842061.886044:0:14350:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464a72361c0 x1874687877540224/t0(0) o250->MGC192.168.202.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787842061.886085:0:14350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a5153086-f7d7-4317-94f4-d9c880bce3b9->MGS 00000020:01000004:2.0:1787842061.886107:0:14350:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787842061.886125:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787842061.886142:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9463826d8000) 00000020:00000080:2.0:1787842061.886187:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787842061.888485:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a5153086-f7d7-4317-94f4-d9c880bce3b9:3305:1874687877540224:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787842061.888564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842061.892392:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540224 00000100:00100000:1.0:1787842061.892405:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540224 00000100:00100000:1.0:1787842061.892452:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787842061.892475:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1874687877540224:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787842061.892502:0:14360:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from a5153086-f7d7-4317-94f4-d9c880bce3b9@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1787842061.892532:0:14360:0:(genops.c:1385:class_connect()) connect: client a5153086-f7d7-4317-94f4-d9c880bce3b9, cookie 0x1d0ed3605e136ed9 00000100:00080000:1.0:1787842061.892679:0:14360:0:(import.c:65:import_set_state_nolock()) ffff9464badbf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787842061.892788:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+5:3305:x1874687877540224:12345-0@lo:250:mount.lustre.0 Request processed in 313us (4221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842061.892796:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787842061.892989:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787842061.893000:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.146@tcp: connect to target with instance 0 00000100:00080000:0.0:1787842061.893008:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787842061.893012:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787842061.893015:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946383a67000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787842061.893018:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787842061.893034:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787842061.893040:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a5153086-f7d7-4317-94f4-d9c880bce3b9:3305:1874687877540224:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787842061.899608:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787842061.900297:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787842061.900305:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787842061.901251:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787842061.901260:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787842061.901645:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787842061.901650:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787842061.902304:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842061.903673:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787842061.903685:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787842061.906362:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787842061.906384:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787842061.954220:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787842061.954907:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787842061.954916:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787842061.956126:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787842061.956138:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787842061.956893:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842061.957060:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787842061.957065:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787842061.957875:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787842061.957882:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787842061.958363:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842061.958660:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787842061.958664:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787842061.959218:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787842061.959225:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787842061.959917:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842061.960077:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787842061.960082:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787842061.961063:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787842061.961073:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787842061.983826:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842061.984109:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787842061.984115:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787842061.986140:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787842061.986177:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787842061.989087:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787842061.989098:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787842061.990994:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787842061.991016:0:14350:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787842061.991022:0:14350:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787842061.991166:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787842061.991213:0:14350:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.146@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787842061.991218:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787842061.991220:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787842061.991221:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842061.991222:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842061.991223:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842061.991224:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842061.991226:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787842061.991227:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787842061.991229:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842061.991230:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787842061.991233:0:14350:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787842061.991236:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787842061.991237:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787842061.991238:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842061.991239:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842061.991245:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842061.991246:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842061.991246:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787842061.991247:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787842061.991248:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842061.991249:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787842061.991285:0:14350:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787842061.991313:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540352:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787842061.991390:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842061.991449:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787842061.991533:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540352 00000100:00100000:1.0:1787842061.991541:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540352 00000100:00100000:1.0:1787842061.991591:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842061.991600:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+5:14350:x1874687877540352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787842061.991652:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787842061.991655:0:14363:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787842061.991658:0:14363:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787842061.991987:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787842061.992407:0:14363:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787842061.993324:0:14385:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787842061.993329:0:14385:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787842061.993330:0:14385:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787842061.993353:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787842061.993692:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787842061.993703:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787842062.002568:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+5:14350:x1874687877540352:12345-0@lo:253:mount.lustre.0 Request processed in 10956us (11164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842062.002588:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787842062.002904:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787842062.002921:0:14350:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787842062.002925:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787842062.002927:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787842062.002928:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842062.002929:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842062.002930:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842062.002932:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842062.002933:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787842062.002935:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787842062.002936:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842062.002938:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787842062.002960:0:14350:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464bfa16800 from lustre-MDT0000 10000000:01000000:2.0:1787842062.002993:0:14350:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787842062.002995:0:14350:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787842062.003001:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9463826dced8 10000000:01000000:2.0:1787842062.003008:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787842062.003023:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9463826dced8 from 1 10000000:01000000:2.0:1787842062.003028:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787842062.003068:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.003079:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.003100:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.003119:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787842062.003173:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.003214:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.003311:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540480 00000100:00100000:1.0:1787842062.003323:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540480 00000100:00100000:1.0:1787842062.003366:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787842062.003375:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+5:14350:x1874687877540480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787842062.003395:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842062.003409:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7246800/0x1d0ed3605e136ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136ee0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.003443:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7246800/0x1d0ed3605e136ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136ee0 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.003454:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7246800/0x1d0ed3605e136ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136ee0 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.003498:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246800, rc 0) 00000100:00100000:1.0:1787842062.003531:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+6:14350:x1874687877540480:12345-0@lo:101:mount.lustre.0 Request processed in 157us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.003537:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787842062.003567:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842062.003580:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.003588:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.003633:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842062.003657:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.003722:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787842062.003871:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540608 00000100:00100000:3.0:1787842062.003876:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540608 00000100:00100000:3.0:1787842062.003908:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787842062.003915:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+6:14350:x1874687877540608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842062.004951:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+6:14350:x1874687877540608:12345-0@lo:501:mount.lustre.0 Request processed in 1030us (1286us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787842062.004961:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787842062.005226:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540608:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787842062.005326:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787842062.005388:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.005398:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842062.005408:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9464bfa16800 10000000:01000000:2.0:1787842062.005423:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787842062.005447:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9464bfa16800 10000000:01000000:2.0:1787842062.005451:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787842062.005469:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9464bfa16800 from 1 10000000:01000000:2.0:1787842062.005472:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787842062.005503:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.005511:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.005520:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.005539:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787842062.005588:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.005629:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787842062.005784:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540736 00000100:00100000:0.0:1787842062.005790:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540736 00000100:00100000:0.0:1787842062.005836:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787842062.005846:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+6:14350:x1874687877540736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787842062.005858:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842062.005878:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480000/0x1d0ed3605e136ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136eee expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.005901:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480000/0x1d0ed3605e136ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136eee expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.005911:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480000/0x1d0ed3605e136ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136eee expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.005919:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480000, rc 0) 00000100:00100000:0.0:1787842062.005962:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+7:14350:x1874687877540736:12345-0@lo:101:mount.lustre.0 Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842062.005968:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787842062.006050:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842062.006063:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ef5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.006070:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136ef5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842062.006082:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787842062.007288:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ef5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.007302:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6df600/0x1d0ed3605e136eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ef5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842062.007328:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787842062.007334:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787842062.007340:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9464bfa16800 10000000:01000000:2.0:1787842062.007343:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787842062.007648:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787842062.007654:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787842062.007691:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.007699:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.007709:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.007730:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787842062.007801:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.007883:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787842062.007997:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540864 00000100:00100000:3.0:1787842062.008006:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540864 00000100:00100000:3.0:1787842062.008067:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787842062.008077:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+7:14350:x1874687877540864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842062.008090:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842062.008106:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c46a00/0x1d0ed3605e136f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136efc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.008128:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c46a00/0x1d0ed3605e136f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136efc expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.008138:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c46a00/0x1d0ed3605e136f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136efc expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.008146:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46a00, rc 0) 00000100:00100000:3.0:1787842062.008253:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+8:14350:x1874687877540864:12345-0@lo:101:mount.lustre.0 Request processed in 176us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842062.008260:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787842062.009245:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842062.009337:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f03 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.009347:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136f03 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.009417:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842062.009533:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.009637:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787842062.009686:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877540992 00000100:00100000:0.0:1787842062.009691:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877540992 00000100:00100000:0.0:1787842062.009781:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842062.009791:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+8:14350:x1874687877540992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842062.010217:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14350:x1874687877540992:12345-0@lo:501:mount.lustre.0 Request processed in 427us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842062.010225:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787842062.010300:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877540992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842062.010332:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877541120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787842062.010371:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.010833:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.012091:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877541120 00000100:00100000:1.0:1787842062.012103:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877541120 00000100:00100000:1.0:1787842062.012174:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787842062.012184:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14350:x1874687877541120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787842062.013007:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14350:x1874687877541120:12345-0@lo:503:mount.lustre.0 Request processed in 822us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.013016:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787842062.013165:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877541120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787842062.013991:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14386:1874687877541248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787842062.014054:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.014121:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.014164:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877541248 00000100:00100000:1.0:1787842062.014170:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877541248 00000100:00100000:1.0:1787842062.014249:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787842062.015749:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14386:x1874687877541248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787842062.016300:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14386:x1874687877541248:12345-0@lo:502:llog_process_th.0 Request processed in 573us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.016320:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787842062.016504:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14386:1874687877541248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787842062.016544:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787842062.016561:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842062.016564:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787842062.016574:0:14386:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787842062.016577:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787842062.016593:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9463826d9a48) 00000020:00000080:2.0:1787842062.016613:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787842062.016619:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787842062.016695:0:14386:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787842062.016701:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136f11 00000020:00000080:2.0:1787842062.016942:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787842062.016946:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787842062.016951:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842062.016952:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787842062.016954:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787842062.016958:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842062.016959:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787842062.016962:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787842062.016978:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9463826db490) 00000020:00000080:2.0:1787842062.016987:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787842062.016991:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787842062.016993:0:14386:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787842062.016996:0:14386:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787842062.017002:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787842062.017062:0:14386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464bfa16800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787842062.017076:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9464871a0000) 00000020:00000080:2.0:1787842062.017084:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787842062.017132:0:14386:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787842062.017137:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e136f26 00000020:00000080:2.0:1787842062.017237:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787842062.017245:0:14386:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787842062.017249:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1d0ed3605e136f2d 00080000:01000000:2.0:1787842062.017254:0:14386:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787842062.017258:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136f34 00010000:00010000:2.0:1787842062.075735:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787842062.076691:0:14386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787842062.077013:0:14386:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787842062.077950:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9464871a4ed8) 00000020:00000080:2.0:1787842062.077971:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787842062.078042:0:14386:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787842062.078048:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136f42 00000020:00000080:2.0:1787842062.079133:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787842062.090357:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1d0ed3605e136f49 00000020:00000080:3.0:1787842062.091324:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787842062.091336:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842062.091342:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842062.091350:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787842062.091354:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787842062.091357:0:14386:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787842062.091358:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787842062.091360:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787842062.091362:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787842062.091365:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842062.091366:0:14386:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787842062.091369:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842062.091374:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842062.091375:0:14386:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787842062.091380:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787842062.091419:0:14386:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787842062.091449:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842062.091453:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842062.091473:0:14386:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787842062.091477:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787842062.091481:0:14386:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787842062.091484:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842062.091486:0:14386:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787842062.091488:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787842062.091493:0:14386:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.146@tcp to nid 0x20000c0a8ca92 (192.168.202.146@tcp) 00000020:01000000:3.0:1787842062.091520:0:14386:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787842062.091524:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787842062.091539:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9464bfa2b490) 00000020:00000080:3.0:1787842062.091553:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787842062.091561:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787842062.091632:0:14386:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787842062.091638:0:14386:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787842062.091645:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136f57 00010000:00080000:3.0:1787842062.091677:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946486703800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.146@tcp at head 00010000:00010000:3.0:1787842062.092229:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787842062.092939:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787842062.093000:0:14386:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787842062.097420:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787842062.097534:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787842062.097611:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787842062.098560:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787842062.098567:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787842062.100682:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787842062.100698:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787842062.100739:0:14386:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787842062.101140:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e136f5e 00000100:00080000:1.0:1787842062.101164:0:14386:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787842062.101171:0:14386:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946486703800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:1.0:1787842062.101212:0:14386:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638291cb40 x1874687877541376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787842062.101312:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877541376:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787842062.101369:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687877541376 offset 0 length 520: 4 00000100:00080000:1.0:1787842062.101502:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787842062.101640:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787842062.101644:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.101646:0:14386:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787842062.101649:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787842062.101652:0:14386:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787842062.101653:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787842062.101655:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787842062.101656:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787842062.101659:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.101660:0:14386:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787842062.101662:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787842062.101666:0:14386:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787842062.101669:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.101671:0:14386:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787842062.101674:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787842062.101677:0:14386:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.146@tcp to nid 0x20000c0a8ca92 (192.168.202.146@tcp) 00000020:01000000:1.0:1787842062.101698:0:14386:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787842062.101700:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787842062.101714:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff946487c1b490) 00000020:00000080:1.0:1787842062.101728:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787842062.101737:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787842062.101814:0:14386:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787842062.101820:0:14386:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787842062.101825:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1d0ed3605e136f6c 00010000:00080000:1.0:1787842062.101856:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9464871f3800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.146@tcp at head 00010000:00010000:1.0:1787842062.102063:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787842062.103636:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787842062.103678:0:14386:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787842062.104176:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787842062.104839:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000100:00100000:2.0:1787842062.104865:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877541504:0@lo:400:kworker.0 00000040:00080000:1.0:1787842062.104949:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787842062.104954:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.105220:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877541504 00000100:00100000:3.0:1787842062.105228:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877541504 00000100:00100000:3.0:1787842062.105287:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787842062.105297:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:3309:x1874687877541504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842062.105362:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:3309:x1874687877541504:12345-0@lo:400:kworker.0 Request processed in 55us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842062.105370:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:1.0:1787842062.105452:0:14392:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787842062.105473:0:14392:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1787842062.105858:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877541504:0@lo:400:kworker.0 00000020:00000080:1.0:1787842062.107093:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787842062.107107:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787842062.107145:0:14386:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787842062.107180:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e136f73 00000100:00080000:1.0:1787842062.107191:0:14386:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787842062.107198:0:14386:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464871f3800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:1.0:1787842062.107231:0:14386:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638291da40 x1874687877541632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787842062.108263:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877541632:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787842062.108335:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687877541632 offset 0 length 520: 4 00000100:00080000:1.0:1787842062.108760:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787842062.108855:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787842062.108862:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.108864:0:14386:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787842062.108867:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787842062.108871:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.108873:0:14386:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787842062.108876:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787842062.108877:0:14386:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787842062.108880:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787842062.108890:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.108892:0:14386:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787842062.108895:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787842062.108897:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.108899:0:14386:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787842062.108903:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787842062.108942:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14386:1874687877541760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787842062.109000:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842062.109023:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.109046:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877541760 00000100:00100000:1.0:1787842062.109052:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877541760 00000100:00100000:1.0:1787842062.109103:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787842062.109111:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14386:x1874687877541760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787842062.109788:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14386:x1874687877541760:12345-0@lo:502:llog_process_th.0 Request processed in 675us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.109798:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787842062.110910:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14386:1874687877541760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787842062.111034:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787842062.111045:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787842062.111047:0:14386:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787842062.111054:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787842062.111289:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787842062.111309:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787842062.111367:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f03 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.111378:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6de400/0x1d0ed3605e136efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f03 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842062.111401:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9464bfa16800 from 1 10000000:01000000:0.0:1787842062.111405:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787842062.111452:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.111482:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.111492:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842062.111513:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877541888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787842062.111567:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842062.111608:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.111611:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877541888 00000100:00100000:2.0:1787842062.111618:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877541888 00000100:00100000:2.0:1787842062.111667:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787842062.111677:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+9:14350:x1874687877541888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842062.111690:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842062.111704:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136f7a expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.111726:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.111737:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.111745:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de800, rc 0) 00000100:00100000:2.0:1787842062.111803:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+10:14350:x1874687877541888:12345-0@lo:101:mount.lustre.0 Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.111810:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787842062.111856:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877541888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787842062.111870:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.111879:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842062.112989:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542016:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787842062.113047:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842062.113129:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842062.113174:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542016 00000100:00100000:3.0:1787842062.113181:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542016 00000100:00100000:3.0:1787842062.113263:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787842062.113272:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+10:14350:x1874687877542016:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787842062.113292:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787842062.113298:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787842062.113395:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+10:14350:x1874687877542016:12345-0@lo:256:mount.lustre.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842062.113402:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787842062.113478:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542016:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787842062.114359:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787842062.114438:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.114450:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842062.114480:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464bfa16800 from 1 10000000:01000000:2.0:1787842062.114537:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787842062.114569:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.114577:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.114586:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.114603:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787842062.114645:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842062.115610:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542144 00000100:00100000:1.0:1787842062.115621:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542144 00000100:00100000:2.0:1787842062.115662:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d3dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.115672:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787842062.115682:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+10:14350:x1874687877542144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787842062.115696:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842062.115713:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136f88 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.115751:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.115761:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.115771:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247c00, rc 0) 00000100:00100000:1.0:1787842062.115824:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877542144:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.115831:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787842062.115891:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842062.115907:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.115916:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.115964:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842062.115987:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.116003:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946487d3dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842062.116033:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542272 00000100:00100000:0.0:1787842062.116037:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542272 00000100:00100000:0.0:1787842062.116059:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787842062.116066:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877542272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787842062.116853:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877542272:12345-0@lo:501:mount.lustre.0 Request processed in 785us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.116863:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787842062.116905:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842062.116983:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787842062.117025:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.117055:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ce9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.117095:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542400 00000100:00100000:1.0:1787842062.117098:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542400 00000100:00100000:1.0:1787842062.117123:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787842062.117127:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877542400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787842062.117510:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877542400:12345-0@lo:503:mount.lustre.0 Request processed in 380us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.117518:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787842062.117611:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787842062.118082:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14394:1874687877542528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787842062.118123:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842062.118171:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787842062.118210:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542528 00000100:00100000:1.0:1787842062.118216:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542528 00000100:00100000:1.0:1787842062.118316:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787842062.118325:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14394:x1874687877542528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787842062.118835:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14394:x1874687877542528:12345-0@lo:502:llog_process_th.0 Request processed in 509us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842062.118852:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787842062.118915:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14394:1874687877542528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787842062.118941:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787842062.118952:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787842062.118955:0:14394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787842062.118961:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464bfa16800 00000020:00000080:0.0:1787842062.118963:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787842062.118971:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787842062.118974:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787842062.118975:0:14394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787842062.118978:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787842062.118980:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787842062.118981:0:14394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787842062.118985:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464bfa16800 00000020:00000080:0.0:1787842062.118986:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787842062.120308:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787842062.120342:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787842062.120344:0:14394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787842062.120348:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787842062.120353:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787842062.120354:0:14394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787842062.120360:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9464bfa16800 00000020:00000080:0.0:1787842062.120362:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787842062.123718:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14394:1874687877542656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787842062.124042:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842062.124088:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ce9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842062.124096:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542656 00000100:00100000:3.0:1787842062.124103:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542656 00000100:00100000:3.0:1787842062.124168:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787842062.124177:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14394:x1874687877542656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787842062.124620:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14394:x1874687877542656:12345-0@lo:502:llog_process_th.0 Request processed in 443us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842062.124629:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787842062.125548:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14394:1874687877542656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787842062.125595:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787842062.125604:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787842062.125606:0:14394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787842062.125610:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787842062.125825:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787842062.125848:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787842062.125873:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.125885:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787842062.125931:0:14350:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787842062.125934:0:14350:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9464bfa16800 10000000:01000000:3.0:1787842062.125937:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9464bfa16800 10000000:01000000:3.0:1787842062.125941:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787842062.125948:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9464bfa16800 from 1 10000000:01000000:3.0:1787842062.125951:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787842062.125983:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.125990:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.125999:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842062.126017:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787842062.126075:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.126112:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.130496:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542784 00000100:00100000:2.0:1787842062.130512:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542784 00000100:00100000:2.0:1787842062.130571:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787842062.130581:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877542784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842062.130613:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842062.130633:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6df800/0x1d0ed3605e136f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136f96 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.130666:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6df800/0x1d0ed3605e136f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136f96 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.130678:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6df800/0x1d0ed3605e136f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136f96 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.130688:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df800, rc 0) 00000100:00100000:2.0:1787842062.130788:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14350:x1874687877542784:12345-0@lo:101:mount.lustre.0 Request processed in 208us (4712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.130795:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787842062.132864:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842062.132902:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f9d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842062.132918:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136f9d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842062.133011:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842062.133072:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.133119:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.133329:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877542912 00000100:00100000:2.0:1787842062.133336:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877542912 00000100:00100000:2.0:1787842062.133430:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787842062.133441:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14350:x1874687877542912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842062.133867:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14350:x1874687877542912:12345-0@lo:501:mount.lustre.0 Request processed in 426us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.133875:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787842062.133959:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877542912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842062.133991:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877543040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787842062.134033:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.134103:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.134145:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543040 00000100:00100000:2.0:1787842062.134161:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543040 00000100:00100000:2.0:1787842062.134193:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787842062.134200:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14350:x1874687877543040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787842062.134345:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14350:x1874687877543040:12345-0@lo:503:mount.lustre.0 Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.134361:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787842062.134438:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877543040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787842062.134944:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14398:1874687877543168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787842062.134984:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.135012:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff946499815e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.135059:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543168 00000100:00100000:2.0:1787842062.135064:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543168 00000100:00100000:2.0:1787842062.135096:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787842062.135103:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14398:x1874687877543168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787842062.135297:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14398:x1874687877543168:12345-0@lo:502:llog_process_th.0 Request processed in 194us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.135305:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787842062.135347:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14398:1874687877543168:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787842062.135402:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787842062.135417:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9464871a3490) 00000020:00000080:2.0:1787842062.135438:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787842062.135532:0:14398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464bfa16800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787842062.135536:0:14398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9464bfa16800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787842062.135539:0:14398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9464bfa16800 4 00010000:00080000:2.0:1787842062.135564:0:14398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9464932ce000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.146@tcp at head 00010000:00010000:3.0:1787842062.142384:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787842062.142663:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787842062.142703:0:14398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787842062.142717:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1d0ed3605e136fab 00000100:00080000:3.0:1787842062.142728:0:14398:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787842062.142734:0:14398:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9464932ce000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:3.0:1787842062.142785:0:14398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638226e940 x1874687877543296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787842062.142817:0:14398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787842062.144962:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877543296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787842062.145039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842062.145087:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543296 00000100:00100000:1.0:1787842062.145096:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543296 00000100:00100000:1.0:1787842062.145133:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787842062.145140:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874687877543296:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787842062.145211:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1874687877543296:12345-0@lo:38:llog_process_th.0 Request processed in 69us (171us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787842062.145218:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787842062.145943:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787842062.145955:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464932ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787842062.145960:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787842062.145964:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877543296:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787842062.146298:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14398:1874687877543424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787842062.146353:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842062.146384:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.148085:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543424 00000100:00100000:2.0:1787842062.148100:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543424 00000100:00100000:2.0:1787842062.148163:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787842062.148176:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14398:x1874687877543424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787842062.152683:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5153086-f7d7-4317-94f4-d9c880bce3b9:14398:1874687877543424:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787842062.152737:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1787842062.152892:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14398:x1874687877543424:12345-0@lo:502:llog_process_th.0 Request processed in 4716us (6535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.152906:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000000:2.0:1787842062.159878:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787842062.159920:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787842062.159950:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f9d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.159975:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946383c47a00/0x1d0ed3605e136f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136f9d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787842062.160134:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787842062.160137:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787842062.160138:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787842062.160140:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787842062.160141:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787842062.160143:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787842062.160144:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787842062.160146:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787842062.160158:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787842062.160160:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787842062.160164:0:14350:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787842062.160167:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787842062.160168:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787842062.160170:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787842062.160171:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787842062.160172:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787842062.160175:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787842062.160176:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787842062.160177:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787842062.160178:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787842062.160179:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787842062.160210:0:14350:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787842062.160231:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877543552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787842062.160311:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842062.160360:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.160703:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543552 00000100:00100000:2.0:1787842062.160712:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543552 00000100:00100000:3.0:1787842062.160851:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787842062.160863:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14350:x1874687877543552:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787842062.160897:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787842062.160915:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787842062.192807:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787842062.192828:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787842062.193080:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787842062.193086:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787842062.193109:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.193129:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.193137:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.193188:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.193202:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 12 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842062.193235:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1874687877543680:0@lo:104: 00000100:00100000:0.0:1787842062.193302:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842062.193349:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.193608:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543680 00000100:00100000:2.0:1787842062.193617:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543680 00000100:00100000:2.0:1787842062.193666:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787842062.193675:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14384:x1874687877543680:12345-0@lo:104: 00010000:00010000:2.0:1787842062.193689:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.193754:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787842062.193875:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14384:x1874687877543680:12345-0@lo:104: Request processed in 87us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.193883:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787842062.193913:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842062.193919:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.193927:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481000 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842062.193931:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.193939:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842062.193960:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842062.193965:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787842062.194040:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194047:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787842062.194069:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194076:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485481000/0x1d0ed3605e136f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136f81 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194092:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842062.194094:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842062.194095:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842062.194136:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5153086-f7d7-4317-94f4-d9c880bce3b9:3306:1874687877543808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787842062.194183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842062.194267:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543808 00000100:00100000:2.0:1787842062.194272:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543808 00010000:00010000:2.0:1787842062.194291:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 13 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.194314:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787842062.194321:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7236d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+13:3306:x1874687877543808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787842062.194331:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787842062.194336:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 13 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194352:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 13 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194369:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194377:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787842062.194391:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001305581s 00010000:00010000:2.0:1787842062.194395:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194402:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194409:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194415:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194420:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842062.194424:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194433:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194441:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194489:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787842062.194521:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7236d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+13:3306:x1874687877543808:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.194529:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787842062.194578:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5153086-f7d7-4317-94f4-d9c880bce3b9:3306:1874687877543808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787842062.194609:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6de800/0x1d0ed3605e136f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e136f7a expref: 12 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842062.194619:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1874687877543680:0@lo:104: 00010000:00010000:2.0:1787842062.194632:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194641:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194646:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.194652:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481200/0x1d0ed3605e136fb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842062.203671:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14350:x1874687877543552:12345-0@lo:253:mount.lustre.0 Request processed in 42801us (43349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842062.203687:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787842062.203836:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:14350:1874687877543552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787842062.203869:0:14350:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787842062.203872:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787842062.203874:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787842062.203875:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787842062.203876:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787842062.203877:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787842062.203879:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787842062.203880:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787842062.203882:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787842062.203884:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787842062.203885:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787842062.203903:0:14350:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787842062.209232:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842062.209411:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842062.209847:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842062.210010:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842062.210293:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842062.210549:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842062.211575:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842062.211743:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842062.212093:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842062.212342:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842062.212752:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842062.212992:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787842062.234711:0:14350:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787842062.235192:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787842062.235376:0:14407:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787842062.235381:0:14407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787842062.235568:0:14408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787842062.235650:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787842062.237656:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787842062.237757:0:14408:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787842062.237762:0:14408:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787842062.240364:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787842062.240522:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787842062.240933:0:14350:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787842062.240940:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787842062.241065:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787842062.242901:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787842062.243441:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787842062.243646:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787842062.245755:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787842062.255959:0:14350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787842062.287755:0:14350:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787842062.287911:0:14350:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb8cac1ca3988 00100000:10000000:2.0:1787842062.287920:0:14350:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787842062.289007:0:14350:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787842062.289025:0:14350:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787842062.289043:0:14350:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787842062.289072:0:14350:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787842062.897841:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787842062.961664:0:14366:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787842062.961674:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9464bfa16800 from 6 10000000:01000000:0.0:1787842062.961680:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787842062.961737:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.961750:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842062.961794:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842062.961833:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877543936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787842062.961922:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842062.961986:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485c04300 going to sleep for 11 seconds 00000100:00100000:2.0:1787842062.962153:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877543936 00000100:00100000:2.0:1787842062.962161:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877543936 00000100:00100000:2.0:1787842062.962221:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787842062.962232:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14366:x1874687877543936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787842062.962246:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842062.962279:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136fb9 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.962305:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.962317:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842062.962326:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787842062.962386:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877543936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842062.962394:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787842062.962707:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877543936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787842062.962724:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.962734:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842062.962799:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877544064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787842062.962848:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842062.962864:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787842062.963183:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544064 00000100:00100000:0.0:1787842062.963189:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544064 00000100:00100000:0.0:1787842062.963298:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787842062.963307:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877544064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787842062.963323:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787842062.963342:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787842062.963345:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787842062.963446:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877544064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842062.963452:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787842062.966223:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877544064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787842062.966334:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787842062.966356:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842062.966370:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787842063.154256:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787842063.925046:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787842064.189670:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787842064.946421:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842065.976396:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842066.998612:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787842067.185735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787842067.185744:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787842067.185747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787842067.185750:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787842067.185765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787842067.185768:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787842067.185773:0:8:0:(import.c:65:import_set_state_nolock()) ffff9464932ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787842067.185785:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9464932ce000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:2.0:1787842067.185814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464a7234f00 x1874687877544320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787842067.185874:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877544320:0@lo:38:kworker.0 00000100:00100000:2.0:1787842067.185969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842067.186239:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787842067.186265:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5153086-f7d7-4317-94f4-d9c880bce3b9:3306:1874687877544192:0@lo:400:kworker.0 00000100:00100000:0.0:1787842067.186308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842067.186516:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544192 00000100:00100000:2.0:1787842067.186524:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544192 00000100:00100000:2.0:1787842067.186580:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787842067.186590:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:3306:x1874687877544192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787842067.186653:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:3306:x1874687877544192:12345-0@lo:400:kworker.0 Request processed in 65us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842067.186660:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787842067.186787:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5153086-f7d7-4317-94f4-d9c880bce3b9:3306:1874687877544192:0@lo:400:kworker.0 00000100:00100000:1.0:1787842067.187579:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544320 00000100:00100000:1.0:1787842067.187587:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544320 00000100:00100000:1.0:1787842067.187613:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842067.187619:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7236940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874687877544320:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787842067.187646:0:14370:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:1.0:1787842067.187690:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1d0ed3605e136fc7 00000004:00100000:1.0:1787842067.187707:0:14370:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787842067.187970:0:14370:0:(import.c:65:import_set_state_nolock()) ffff9464c1af1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787842067.188090:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7236940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874687877544320:12345-0@lo:38:kworker.0 Request processed in 470us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842067.188107:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787842067.188430:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9464a7234f00 x1874687877544320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787842077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787842067.188447:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787842067.188477:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787842067.188483:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787842067.188486:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464932ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787842067.188493:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874687877544320:0@lo:38:kworker.0 00000001:02000400:0.0:1787842067.734974:0:14651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787842068.028267:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842069.050599:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842070.065909:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787842070.975109:0:14801:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef57a5590 20000000:00000080:0.0:1787842070.975128:0:14801:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946488482400 uarg=0000000000000000 20000000:01000000:0.0:1787842070.975163:0:14801:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787842070.975170:0:14801:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787842070.975175:0:14801:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787842070.976161:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787842070.976336:0:14801:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787842070.981684:0:14801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787842070.981719:0:14801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.981737:0:14801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.981745:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.981792:0:14801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.981808:0:14801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 11 pid: 14360 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842070.981822:0:14801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14801:1874687877544448:0@lo:104: 00000100:00100000:0.0:1787842070.981884:0:14801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842070.981945:0:14801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787842070.982092:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544448 00000100:00100000:1.0:1787842070.982100:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544448 00000100:00100000:1.0:1787842070.982183:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842070.982206:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14801:x1874687877544448:12345-0@lo:104: 00010000:00010000:1.0:1787842070.982219:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982281:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787842070.982288:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14801:x1874687877544448:12345-0@lo:104: Request processed in 85us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842070.982295:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787842070.982319:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842070.982325:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982333:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787842070.982337:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982345:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787842070.982352:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842070.982358:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787842070.982387:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982393:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787842070.982413:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982431:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff94648a6df000/0x1d0ed3605e136f88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136f8f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982451:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842070.982453:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842070.982485:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842070.982508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877544576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842070.982540:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842070.982582:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544576 00000100:00100000:1.0:1787842070.982587:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544576 00010000:00010000:1.0:1787842070.982604:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 12 pid: 14360 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842070.982624:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842070.982630:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:3308:x1874687877544576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842070.982641:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842070.982646:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 12 pid: 14360 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982656:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 12 pid: 14360 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982686:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982695:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982709:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982723:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982730:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982736:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982741:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842070.982745:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982753:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982762:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842070.982772:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842070.982801:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:3308:x1874687877544576:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842070.982808:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842070.982845:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877544576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842070.983052:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7247c00/0x1d0ed3605e136f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e136f88 expref: 11 pid: 14360 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842070.983073:0:14801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14801:1874687877544448:0@lo:104: 00010000:00010000:0.0:1787842070.983086:0:14801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.983095:0:14801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.983101:0:14801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842070.983114:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480800/0x1d0ed3605e136fce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842071.091520:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842072.113583:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842072.305629:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842062/real 1787842062] req@ffff94638291da40 x1874687877541632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787842072.305656:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94638291da40 x1874687877541632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787842072.305679:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842062/real 1787842062] req@ffff94638291cb40 x1874687877541376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787842072.305691:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94638291cb40 x1874687877541376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787842072.305709:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787842072.307148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787842072.307156:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787842072.307159:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787842072.307162:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787842072.307176:0:37:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787842072.307186:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00100000:0.0:1787842072.307186:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787842072.307196:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787842072.307205:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464871f3800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842072.307211:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877544704:0@lo:400:kworker.0 00000100:00100000:3.0:1787842072.307230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638226cf00 x1874687877544832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787842072.307287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842072.307389:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544704 00000100:00100000:0.0:1787842072.307396:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544704 00000100:00100000:3.0:1787842072.307429:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877544960:0@lo:400:kworker.0 00000100:00100000:0.0:1787842072.307445:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787842072.307476:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:3308:x1874687877544704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842072.307494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842072.307541:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:3308:x1874687877544704:12345-0@lo:400:kworker.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842072.307549:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787842072.307595:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877544960 00000100:00100000:0.0:1787842072.307599:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877544960 00000100:00100000:0.0:1787842072.307633:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787842072.307642:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877544960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842072.307686:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877544960:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842072.307692:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787842072.307737:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94638226e940 x1874687877544960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842072.307750:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877544960:0@lo:400:kworker.0 00000100:00100000:0.0:1787842072.307775:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877544704:0@lo:400:kworker.0 00000100:00080000:2.0:1787842072.308506:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787842072.308513:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877541632:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787842072.308520:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946486703800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787842072.308526:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787842072.308529:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877541376:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787842072.308553:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877544832:0@lo:8:kworker.0 00000400:00000100:2.0:1787842072.308588:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687877544832 offset 0 length 520: 4 00000100:00080000:3.0:1787842072.310368:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787842072.310377:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787842072.310382:0:37:0:(import.c:65:import_set_state_nolock()) ffff946486703800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787842072.310389:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:3.0:1787842072.310396:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787842072.310404:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946486703800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:3.0:1787842072.310444:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638226d2c0 x1874687877545088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787842072.310583:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877545088:0@lo:8:kworker.0 00000400:00000100:0.0:1787842072.310629:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687877545088 offset 0 length 520: 4 10000000:01000000:2.0:1787842072.754681:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787842072.754689:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464bfa16800 from 10 10000000:01000000:2.0:1787842072.754694:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787842072.754744:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842072.754756:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842072.754786:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842072.754812:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877545216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787842072.754886:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842072.754943:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648524c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787842072.755071:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545216 00000100:00100000:0.0:1787842072.755078:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545216 00000100:00100000:0.0:1787842072.755139:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787842072.755149:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+11:14366:x1874687877545216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787842072.755163:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842072.755184:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136fd5 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842072.755209:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842072.755221:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842072.755229:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481000, rc 0) 00000100:00100000:0.0:1787842072.755279:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877545216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842072.755286:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787842072.755770:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877545216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787842072.755789:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842072.755799:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842072.755870:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877545344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787842072.755901:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842072.755923:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648524c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787842072.756030:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545344 00000100:00100000:0.0:1787842072.756036:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545344 00000100:00100000:0.0:1787842072.756073:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787842072.756080:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877545344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787842072.756361:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877545344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842072.756369:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787842072.756412:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877545344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787842072.756447:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877545472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787842072.756503:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842072.756520:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464bf7dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787842072.756533:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545472 00000100:00100000:0.0:1787842072.756536:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545472 00000100:00100000:0.0:1787842072.756559:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787842072.756566:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877545472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787842072.756861:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:14366:x1874687877545472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842072.756869:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787842072.756908:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877545472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787842072.761220:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787842072.763781:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787842072.763819:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787842072.763832:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842072.763844:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842073.146431:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842074.164781:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787842074.424394:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787842075.185628:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842076.214818:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787842076.881323:0:15051:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787842076.881328:0:15051:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787842076.882656:0:15051:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946383a60800 00000020:01000004:2.0:1787842076.882684:0:15051:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787842076.882701:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787842076.882719:0:15051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9464871a1a48) 00000020:00000080:2.0:1787842076.882738:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787842076.927678:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787842076.927955:0:15051:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787842076.928717:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787842076.928954:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787842076.929182:0:15051:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787842076.929614:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 411: rc = 0 00100000:10000000:3.0:1787842076.929779:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 411: rc = 0 00100000:10000000:3.0:1787842076.929890:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 411: rc = 0 00100000:10000000:2.0:1787842076.937431:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 532: rc = 0 00100000:10000000:2.0:1787842076.938019:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 532: rc = 0 00100000:10000000:2.0:1787842076.938339:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 532: rc = 0 00100000:10000000:2.0:1787842076.943165:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 532: rc = 0 00100000:10000000:2.0:1787842076.943543:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 532: rc = 0 00100000:10000000:2.0:1787842076.943801:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 532: rc = 0 00000020:00000080:2.0:1787842076.944438:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787842076.944449:0:15051:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787842076.944488:0:15051:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d0ed3605e136fea 00000020:01000004:2.0:1787842076.944497:0:15051:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787842076.944520:0:15051:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787842076.944524:0:15051:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787842076.944530:0:15051:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787842076.944534:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787842076.944545:0:15051:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9464870b3490) 00000020:00000080:2.0:1787842076.944555:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787842076.956967:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787842076.957213:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787842076.957220:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787842076.968119:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787842076.968131:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787842076.970844:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787842076.970857:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787842076.973315:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787842076.976817:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787842076.976832:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787842076.985177:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787842076.985194:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787842077.039709:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842077.039963:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787842077.039970:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787842077.045729:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787842077.045748:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787842077.057638:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787842077.057661:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787842077.070743:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787842077.070969:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787842077.070982:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787842077.075439:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787842077.075754:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787842077.201993:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787842077.202223:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787842077.202231:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787842077.205963:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787842077.205984:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787842077.206728:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787842077.206756:0:15051:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787842077.206763:0:15051:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:0.0:1787842077.234085:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787842077.239263:0:15051:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787842077.239305:0:15051:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.146@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787842077.239309:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787842077.239311:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787842077.239312:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842077.239314:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842077.239314:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842077.239316:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842077.239318:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787842077.239320:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842077.239326:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787842077.239329:0:15051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787842077.239331:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787842077.239332:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787842077.239333:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842077.239333:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842077.239334:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842077.239334:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842077.239335:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787842077.239336:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842077.239336:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787842077.239362:0:15051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787842077.239381:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787842077.240965:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.241051:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485c04f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.241111:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545600 00000100:00100000:0.0:1787842077.241122:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545600 00000100:00100000:0.0:1787842077.241195:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787842077.241205:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:15051:x1874687877545600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787842077.241249:0:14363:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787842077.241252:0:14363:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787842077.241256:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787842077.261170:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:15051:x1874687877545600:12345-0@lo:253:mount.lustre.0 Request processed in 19953us (21699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842077.261187:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787842077.261306:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787842077.261325:0:15051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787842077.261328:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787842077.261330:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787842077.261331:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842077.261332:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842077.261334:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842077.261336:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842077.261338:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787842077.261340:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842077.261341:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787842077.261369:0:15051:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946383a60800 from lustre-OST0000 10000000:01000000:2.0:1787842077.261415:0:15051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787842077.261418:0:15051:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787842077.261426:0:15051:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9463826dced8 local copy 00010000:00010000:2.0:1787842077.261441:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842077.261954:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842077.262012:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.262095:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489a6b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.262140:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545728 00000100:00100000:0.0:1787842077.262147:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545728 00000100:00100000:0.0:1787842077.262225:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787842077.262235:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:15051:x1874687877545728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842077.262431:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:15051:x1874687877545728:12345-0@lo:501:mount.lustre.0 Request processed in 196us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787842077.262439:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787842077.262544:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545728:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787842077.262557:0:15051:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787842077.262822:0:15051:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787842077.262830:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.262841:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787842077.262862:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946383a60800 10000000:01000000:3.0:1787842077.262867:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787842077.262871:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9463826dced8 10000000:01000000:3.0:1787842077.262873:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787842077.262877:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9463826dced8 from 1 10000000:01000000:3.0:1787842077.262879:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787842077.262904:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.262911:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.262919:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842077.262933:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787842077.262962:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.263057:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.263152:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545856 00000100:00100000:0.0:1787842077.263157:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545856 00000100:00100000:0.0:1787842077.263189:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787842077.263195:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+12:15051:x1874687877545856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787842077.263205:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842077.263224:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480c00/0x1d0ed3605e136fff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e136ff8 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842077.263244:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480c00/0x1d0ed3605e136fff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e136ff8 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842077.263254:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480c00/0x1d0ed3605e136fff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136ff8 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842077.263262:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480c00, rc 0) 00000100:00100000:0.0:1787842077.263296:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+13:15051:x1874687877545856:12345-0@lo:101:mount.lustre.0 Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.263302:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787842077.263399:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842077.263420:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fff expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.263429:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e136fff expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787842077.263444:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787842077.263484:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fff expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.263492:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946383c46200/0x1d0ed3605e136ff8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136fff expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787842077.263499:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787842077.263502:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787842077.263506:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787842077.263508:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787842077.263521:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.263528:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.263536:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842077.263547:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787842077.263570:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.263588:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842077.263663:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877545984 00000100:00100000:2.0:1787842077.263667:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877545984 00000100:00100000:2.0:1787842077.263699:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787842077.263707:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+13:15051:x1874687877545984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842077.263714:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842077.263722:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dfc00/0x1d0ed3605e13700d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e137006 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.263736:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dfc00/0x1d0ed3605e13700d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e137006 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.263745:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dfc00/0x1d0ed3605e13700d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137006 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.263752:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfc00, rc 0) 00000100:00100000:2.0:1787842077.263779:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877545984:12345-0@lo:101:mount.lustre.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842077.263784:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787842077.263986:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877545984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842077.263996:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13700d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.264014:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e13700d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787842077.264898:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787842077.266292:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787842077.266588:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787842077.266784:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787842077.266823:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787842077.266873:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787842077.266911:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787842077.266947:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787842077.267035:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787842077.267043:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787842077.267134:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842077.267215:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.267257:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.267342:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546112 00000100:00100000:0.0:1787842077.267349:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546112 00000100:00100000:0.0:1787842077.267401:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787842077.267411:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842077.267786:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546112:12345-0@lo:501:mount.lustre.0 Request processed in 376us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.267795:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787842077.268913:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842077.269011:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787842077.269072:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.269102:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946489b08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.269215:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546240 00000100:00100000:0.0:1787842077.269221:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546240 00000100:00100000:0.0:1787842077.269307:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787842077.269317:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787842077.269650:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546240:12345-0@lo:503:mount.lustre.0 Request processed in 335us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.269656:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787842077.269928:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546240:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787842077.270832:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787842077.270961:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842077.271041:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.271138:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464880b09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787842077.271184:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546368 00000100:00100000:2.0:1787842077.271191:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546368 00000100:00100000:2.0:1787842077.271286:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787842077.271298:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787842077.271498:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546368:12345-0@lo:502:mount.lustre.0 Request processed in 204us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842077.271504:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787842077.271574:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787842077.271755:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787842077.271805:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787842077.271840:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787842077.271917:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787842077.271959:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787842077.271981:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787842077.272038:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787842077.272085:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787842077.272121:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787842077.272170:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787842077.272208:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787842077.272256:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787842077.272281:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842077.272315:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.272345:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464880b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.272367:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546496 00000100:00100000:0.0:1787842077.272378:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546496 00000100:00100000:0.0:1787842077.272452:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787842077.272483:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787842077.272635:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546496:12345-0@lo:502:mount.lustre.0 Request processed in 153us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.272643:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787842077.274543:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787842077.274679:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787842077.274694:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787842077.275452:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787842077.275485:0:15065:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787842077.275490:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.275491:0:15065:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787842077.275495:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787842077.275509:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9464bfa2ced8) 00000020:00000080:3.0:1787842077.275528:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787842077.275532:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787842077.275604:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946383a60800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787842077.275611:0:15065:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787842077.275618:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1d0ed3605e13701b 00010000:00010000:3.0:1787842077.280073:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787842077.280912:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787842077.284794:0:15065:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787842077.286058:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787842077.286070:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842077.286076:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.286078:0:15065:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787842077.286082:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787842077.286084:0:15065:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787842077.286086:0:15065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787842077.286087:0:15065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787842077.286088:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787842077.286090:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.286091:0:15065:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787842077.286094:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842077.286096:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.286098:0:15065:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787842077.286101:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787842077.286102:0:15065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787842077.286104:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842077.286106:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.286107:0:15065:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787842077.286110:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842077.286239:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.286241:0:15065:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787842077.286246:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787842077.286300:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842077.286303:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842077.286304:0:15065:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787842077.286309:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787842077.286523:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787842077.286553:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787842077.286581:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13700d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842077.286592:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946383c46e00/0x1d0ed3605e137006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13700d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842077.286601:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946383a60800 from 1 10000000:01000000:0.0:1787842077.286604:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787842077.286641:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842077.286649:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842077.286663:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842077.286689:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787842077.287046:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842077.287142:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871c9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787842077.287327:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546624 00000100:00100000:3.0:1787842077.287345:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546624 00000100:00100000:3.0:1787842077.287441:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787842077.287452:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+14:15051:x1874687877546624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842077.287491:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842077.287508:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e137022 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.287534:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.287546:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.287556:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47c00, rc 0) 00000100:00100000:3.0:1787842077.287616:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877546624:12345-0@lo:101:mount.lustre.0 Request processed in 166us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842077.287623:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787842077.287701:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842077.287726:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.287736:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787842077.288316:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787842077.289061:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787842077.289315:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787842077.289361:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787842077.289425:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787842077.289434:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787842077.289552:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842077.289619:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.290075:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485c04300 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.290247:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546752 00000100:00100000:0.0:1787842077.290266:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546752 00000100:00100000:0.0:1787842077.290336:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787842077.290345:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877546752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842077.290777:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877546752:12345-0@lo:501:mount.lustre.0 Request processed in 431us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.290786:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787842077.291028:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842077.291068:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787842077.291453:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.291642:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485c04300 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.291689:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877546880 00000100:00100000:0.0:1787842077.291696:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877546880 00000100:00100000:0.0:1787842077.291780:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787842077.291790:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877546880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787842077.292019:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877546880:12345-0@lo:503:mount.lustre.0 Request processed in 231us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.292027:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787842077.292189:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877546880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787842077.292876:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787842077.292953:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842077.293018:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.293819:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547008 00000100:00100000:2.0:1787842077.293828:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547008 00000100:00100000:2.0:1787842077.293939:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787842077.293949:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877547008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787842077.294310:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877547008:12345-0@lo:502:mount.lustre.0 Request processed in 362us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842077.294317:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787842077.295542:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464880b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787842077.295582:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787842077.296414:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787842077.297159:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787842077.297230:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787842077.297269:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787842077.297303:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787842077.297348:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787842077.297383:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787842077.297425:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787842077.297506:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787842077.297590:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.297637:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485c04e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787842077.297809:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547136 00000100:00100000:0.0:1787842077.297819:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547136 00000100:00100000:0.0:1787842077.297892:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787842077.297904:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877547136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787842077.298143:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877547136:12345-0@lo:502:mount.lustre.0 Request processed in 241us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.298164:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787842077.298381:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787842077.298526:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787842077.298538:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787842077.299652:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787842077.299664:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842077.299666:0:15069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787842077.299675:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946383a60800 00000020:00000080:2.0:1787842077.299678:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787842077.299685:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787842077.299688:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842077.299690:0:15069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787842077.299692:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787842077.299694:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842077.299696:0:15069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787842077.299700:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946383a60800 00000020:00000080:2.0:1787842077.299702:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787842077.299749:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787842077.299752:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842077.299758:0:15069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787842077.299761:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787842077.299764:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842077.299766:0:15069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787842077.299769:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946383a60800 00000020:00000080:2.0:1787842077.299771:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787842077.299810:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787842077.299814:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787842077.299815:0:15069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787842077.299819:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787842077.302926:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787842077.302972:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787842077.303009:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.303023:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842077.303082:0:15051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787842077.303085:0:15051:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946383a60800 10000000:01000000:1.0:1787842077.303088:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946383a60800 10000000:01000000:1.0:1787842077.303092:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787842077.303099:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946383a60800 from 1 10000000:01000000:1.0:1787842077.303101:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787842077.303142:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.303150:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.303163:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842077.303189:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787842077.303555:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842077.303935:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547264 00000100:00100000:3.0:1787842077.303944:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547264 00000100:00100000:1.0:1787842077.303947:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787842077.304015:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787842077.304026:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877547264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842077.304043:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842077.304059:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c47600/0x1d0ed3605e137037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e137030 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.304102:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c47600/0x1d0ed3605e137037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e137030 expref: 16 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.304122:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c47600/0x1d0ed3605e137037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137030 expref: 16 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.304132:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47600, rc 0) 00000100:00100000:3.0:1787842077.304266:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547264:12345-0@lo:101:mount.lustre.0 Request processed in 240us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842077.304273:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787842077.304298:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787842077.304314:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137037 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.304335:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e137037 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787842077.312188:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787842077.312743:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787842077.313042:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787842077.313087:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787842077.313123:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787842077.313169:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787842077.313205:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787842077.313248:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787842077.313300:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787842077.313337:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787842077.313389:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787842077.313426:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787842077.313486:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787842077.313538:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787842077.313573:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787842077.313602:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787842077.313648:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787842077.313685:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787842077.313718:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787842077.313764:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787842077.313800:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787842077.313833:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787842077.313880:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787842077.313915:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787842077.313970:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787842077.320397:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787842077.320509:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787842077.320544:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787842077.320632:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787842077.320669:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787842077.320757:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787842077.320764:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787842077.320887:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787842077.320962:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842077.321033:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787842077.321350:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547392 00000100:00100000:2.0:1787842077.321359:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547392 00000100:00100000:2.0:1787842077.321418:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787842077.321429:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842077.322075:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547392:12345-0@lo:501:mount.lustre.0 Request processed in 646us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842077.322084:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787842077.324025:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787842077.324084:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787842077.324150:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842077.324186:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787842077.326411:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547520 00000100:00100000:3.0:1787842077.326424:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547520 00000100:00100000:3.0:1787842077.326506:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787842077.326518:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787842077.326790:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547520:12345-0@lo:503:mount.lustre.0 Request processed in 274us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842077.326799:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787842077.327074:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787842077.329044:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787842077.329139:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787842077.329225:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842077.329281:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547648 00000100:00100000:1.0:1787842077.329288:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547648 00000100:00100000:1.0:1787842077.329332:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787842077.329342:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787842077.329561:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547648:12345-0@lo:502:mount.lustre.0 Request processed in 220us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842077.329568:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787842077.330529:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787842077.330561:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787842077.333586:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787842077.334483:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787842077.334519:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787842077.334578:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787842077.335502:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787842077.335576:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787842077.336299:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787842077.336334:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787842077.336380:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787842077.336410:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787842077.336438:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787842077.336516:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787842077.336554:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787842077.336586:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787842077.342205:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787842077.342302:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787842077.342339:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787842077.342392:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787842077.342428:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787842077.342489:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787842077.342539:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787842077.342571:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787842077.342647:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787842077.342699:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787842077.342734:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787842077.342769:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787842077.342835:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787842077.342873:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787842077.342906:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787842077.342955:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787842077.342989:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787842077.343037:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787842077.343068:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787842077.343116:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787842077.343162:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787842077.343212:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787842077.343247:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787842077.343278:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787842077.343343:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787842077.343381:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787842077.343443:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787842077.343565:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842077.343607:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff946490e9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787842077.343770:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547776 00000100:00100000:3.0:1787842077.343780:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547776 00000100:00100000:3.0:1787842077.343850:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787842077.343859:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842077.344107:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877547776:12345-0@lo:502:mount.lustre.0 Request processed in 249us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842077.344555:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787842077.344768:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877547776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787842077.344882:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787842077.344895:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787842077.348067:0:15073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787842077.348086:0:15073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff946487c18000) 00000020:00000080:1.0:1787842077.348108:0:15073:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787842077.348242:0:15073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946383a60800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787842077.348246:0:15073:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946383a60800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787842077.348248:0:15073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946383a60800 3 00010000:00080000:1.0:1787842077.348280:0:15073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9464835e4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.146@tcp at head 00010000:00010000:0.0:1787842077.358317:0:15073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787842077.358579:0:15073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787842077.358620:0:15073:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787842077.358635:0:15073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1d0ed3605e137045 00000100:00080000:0.0:1787842077.358649:0:15073:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787842077.358655:0:15073:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9464835e4000 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842077.358689:0:15073:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464884c61c0 x1874687877547904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787842077.358724:0:15073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787842077.358751:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787842077.358756:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787842077.358758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787842077.358762:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787842077.358812:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787842077.358826:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877548032:0@lo:400:kworker.0 00000100:00100000:0.0:1787842077.358902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842077.358956:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548032 00000100:00100000:0.0:1787842077.358962:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548032 00000100:00100000:0.0:1787842077.359013:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787842077.359023:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877548032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842077.359074:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877548032:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842077.359081:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787842077.359115:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9464884c7480 x1874687877548032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842077.359128:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877548032:0@lo:400:kworker.0 00000040:00080000:0.0:1787842077.359357:0:15073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787842077.360589:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787842077.360634:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787842077.360663:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137037 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842077.360675:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464a7247a00/0x1d0ed3605e137030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137037 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787842077.360728:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787842077.360730:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787842077.360732:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787842077.360733:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787842077.360734:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787842077.360736:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787842077.360737:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787842077.360740:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787842077.360742:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787842077.360746:0:15051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787842077.360749:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787842077.360751:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787842077.360752:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787842077.360753:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787842077.360754:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787842077.360755:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787842077.360756:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787842077.360757:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787842077.360758:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787842077.360784:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874687877547904:0@lo:38:llog_process_th.0 10000000:01000000:3.0:1787842077.360785:0:15051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787842077.360800:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877548160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787842077.365157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.371514:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877547904 00000100:00100000:2.0:1787842077.371530:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877547904 00000100:00100000:2.0:1787842077.371582:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787842077.371691:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1874687877547904:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787842077.371725:0:14369:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1787842077.371763:0:14369:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1d0ed3605e13704c 00000004:00100000:2.0:1787842077.371927:0:14369:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787842077.371967:0:14369:0:(import.c:65:import_set_state_nolock()) ffff9464bf7d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787842077.372077:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874687877547904:12345-0@lo:38:llog_process_th.0 Request processed in 486us (6994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842077.372129:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.372151:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787842077.372255:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9464884c61c0 x1874687877547904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787842087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787842077.372265:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787842077.372272:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787842077.372278:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787842077.372282:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787842077.372284:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464835e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787842077.372288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1874687877547904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787842077.372530:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464880b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787842077.374229:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548160 00000100:00100000:3.0:1787842077.374241:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548160 00000100:00100000:3.0:1787842077.374296:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787842077.374307:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15051:x1874687877548160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787842077.374340:0:14360:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787842077.374356:0:14360:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787842077.414498:0:14360:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787842077.414517:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787842077.414684:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787842077.414690:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787842077.414716:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.414737:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 16 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.414745:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.414795:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 16 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842077.414809:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 16 pid: 14360 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842077.414823:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1874687877548288:0@lo:104: 00000100:00100000:2.0:1787842077.414889:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842077.414936:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9463835fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787842077.415015:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548288 00000100:00100000:1.0:1787842077.415034:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548288 00000100:00100000:1.0:1787842077.415082:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787842077.415090:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7237840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14384:x1874687877548288:12345-0@lo:104: 00010000:00010000:1.0:1787842077.415103:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415169:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787842077.415175:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7237840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14384:x1874687877548288:12345-0@lo:104: Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842077.415184:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787842077.415206:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842077.415212:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415219:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480a00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:1.0:1787842077.415224:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415233:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787842077.415241:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842077.415247:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787842077.415276:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415283:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787842077.415300:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415312:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e136fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136fc0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415329:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842077.415330:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842077.415332:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842077.415342:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787842077.415351:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877548416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787842077.415378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842077.415404:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548416 00000100:00100000:1.0:1787842077.415408:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548416 00010000:00010000:1.0:1787842077.415422:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 17 pid: 14360 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842077.415440:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787842077.415446:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:3309:x1874687877548416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842077.415482:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842077.415487:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 17 pid: 14360 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415498:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 17 pid: 14360 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415512:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415521:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787842077.415542:0:14355:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001305581s 00010000:00010000:1.0:1787842077.415547:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415554:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415561:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415567:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415572:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842077.415576:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415584:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415592:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415600:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842077.415642:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:3309:x1874687877548416:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842077.415648:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787842077.415681:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877548416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787842077.415704:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e136fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e136fb9 expref: 16 pid: 14360 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842077.415719:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1874687877548288:0@lo:104: 00010000:00010000:1.0:1787842077.415732:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415740:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415747:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842077.415753:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137053 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842077.429748:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:15051:x1874687877548160:12345-0@lo:253:mount.lustre.0 Request processed in 55432us (57608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842077.429764:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787842077.429945:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15051:1874687877548160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787842077.429963:0:15051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787842077.429976:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787842077.429978:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787842077.429979:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787842077.429980:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787842077.429981:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787842077.429982:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787842077.429984:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787842077.429986:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787842077.429987:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787842077.430015:0:15051:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787842077.434236:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842077.434409:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842077.434783:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842077.434942:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787842077.435107:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787842077.435789:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787842077.438972:0:15051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787842077.508698:0:15051:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787842077.508707:0:15051:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787842077.508741:0:15051:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787842077.508806:0:15051:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787842077.508822:0:15051:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787842077.508859:0:15051:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787842078.259591:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787842078.961527:0:14366:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787842078.961538:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9464bfa16800 from 7 10000000:01000000:0.0:1787842078.961544:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787842078.961607:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842078.961620:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842078.961759:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842078.961788:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877548544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787842078.961870:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842078.961932:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464893e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787842078.962111:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548544 00000100:00100000:3.0:1787842078.962121:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548544 00000100:00100000:3.0:1787842078.962222:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787842078.962232:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+15:14366:x1874687877548544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842078.962248:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842078.962264:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e13705a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842078.962289:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842078.962300:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842078.962310:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47400, rc 0) 00000100:00100000:3.0:1787842078.962361:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:14366:x1874687877548544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842078.962369:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787842078.962452:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877548544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787842078.962504:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842078.962514:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842078.962575:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877548672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787842078.962624:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842078.968884:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464893e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787842078.972769:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548672 00000100:00100000:1.0:1787842078.972790:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548672 00000100:00100000:3.0:1787842078.975874:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787842078.975890:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:14366:x1874687877548672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787842078.975919:0:14362:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787842078.975938:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787842078.975941:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787842078.976216:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:14366:x1874687877548672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 330us (13589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842078.976233:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787842078.976280:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877548672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787842078.976362:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787842078.976375:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842078.976388:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842079.281687:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842080.306598:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842081.330818:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842082.353846:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787842082.546695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787842082.546704:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787842082.546707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787842082.546710:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787842082.546756:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877548800:0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.546837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842082.546907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877548928:0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.546956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842082.546980:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787842082.546986:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877549056:0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.547013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842082.547046:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548800 00000100:00100000:3.0:1787842082.547065:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548800 00000100:00100000:3.0:1787842082.547114:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787842082.547123:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:3309:x1874687877548800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.547175:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:3309:x1874687877548800:12345-0@lo:400:kworker.0 Request processed in 53us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842082.547182:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787842082.547223:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877548928 00000100:00100000:3.0:1787842082.547226:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877548928 00000100:00100000:3.0:1787842082.547247:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549056 00000100:00100000:3.0:1787842082.547249:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549056 00000100:00100000:3.0:1787842082.547272:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787842082.547277:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877548928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.547308:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877548928:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842082.547314:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787842082.547323:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787842082.547328:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877549056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.547350:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877549056:12345-0@lo:400:kworker.0 Request processed in 22us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842082.547355:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787842082.547395:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94638226e1c0 x1874687877549056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842082.547409:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877549056:0@lo:400:kworker.0 00010000:00080000:3.0:1787842082.547418:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94638226f840 x1874687877548928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842082.547427:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877548928:0@lo:400:kworker.0 00000100:00100000:3.0:1787842082.547485:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877548800:0@lo:400:kworker.0 00000100:00080000:1.0:1787842082.550641:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787842083.377709:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842084.401701:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787842084.519936:0:15417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787842084.659074:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787842085.426609:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842086.450262:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842087.474200:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787842087.603754:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842072/real 1787842072] req@ffff94638226d2c0 x1874687877545088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842087.603794:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94638226d2c0 x1874687877545088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842087.603805:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787842072/real 1787842072] req@ffff94638226cf00 x1874687877544832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842087.603816:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94638226cf00 x1874687877544832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787842087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787842087.603836:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946486703800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787842087.603862:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787842087.603867:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877545088:0@lo:8:kworker.0 00000100:00080000:3.0:1787842087.603873:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787842087.603878:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787842087.603881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877544832:0@lo:8:kworker.0 00000100:00080000:0.0:1787842087.603992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787842087.603997:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787842087.604001:0:37:0:(import.c:65:import_set_state_nolock()) ffff946486703800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787842087.604005:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:0.0:1787842087.604011:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787842087.604020:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946486703800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842087.604058:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464884c7480 x1874687877549312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787842087.604076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787842087.604079:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787842087.604082:0:37:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787842087.604085:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:0.0:1787842087.604087:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787842087.604090:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464871f3800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842087.604102:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464884c6580 x1874687877549440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787842087.604160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877549184:0@lo:400:kworker.0 00000100:00100000:0.0:1787842087.604162:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877549696:0@lo:400:kworker.0 00000100:00100000:1.0:1787842087.604232:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877549568:0@lo:400:kworker.0 00000100:00100000:2.0:1787842087.604296:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877549312:0@lo:8:kworker.0 00000100:00100000:3.0:1787842087.605133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842087.605403:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549184 00000100:00100000:3.0:1787842087.605422:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549184 00000100:00100000:3.0:1787842087.605495:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787842087.605820:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:3308:x1874687877549184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842087.605904:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:3308:x1874687877549184:12345-0@lo:400:kworker.0 Request processed in 388us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842087.605912:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787842087.605970:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877549184:0@lo:400:kworker.0 00000100:00100000:0.0:1787842087.607254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842087.608410:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549696 00000100:00100000:3.0:1787842087.608422:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549696 00000100:00100000:3.0:1787842087.608712:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787842087.608724:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877549696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842087.608808:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874687877549696:12345-0@lo:400:kworker.0 Request processed in 88us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842087.608816:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787842087.609103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842087.609149:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549568 00000100:00100000:1.0:1787842087.609153:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549568 00000100:00100000:1.0:1787842087.609181:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787842087.609196:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877549568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842087.609235:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877549568:12345-0@lo:400:kworker.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842087.609241:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787842087.609297:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464884c61c0 x1874687877549568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787842087.609327:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877549568:0@lo:400:kworker.0 00000100:00080000:0.0:1787842087.609667:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787842087.609696:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464884c70c0 x1874687877549696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842087.609706:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1874687877549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787842087.615707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842087.615784:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877549440:0@lo:8:kworker.0 00000100:00100000:2.0:1787842087.615820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842087.615865:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549312 00000100:00100000:2.0:1787842087.615872:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549312 00000100:00100000:2.0:1787842087.615914:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549440 00000100:00100000:2.0:1787842087.615918:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549440 00000100:00100000:2.0:1787842087.615931:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787842087.615937:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7236580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874687877549312:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787842087.615967:0:15054:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1787842087.615998:0:15054:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e137068 00002000:00100000:2.0:1787842087.616012:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9464871c4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787842087.616016:0:15054:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787842087.616019:0:15054:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787842087.617147:0:15054:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787842087.617176:0:15054:0:(import.c:65:import_set_state_nolock()) ffff9464870fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787842087.617234:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7236580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874687877549312:12345-0@lo:8:kworker.0 Request processed in 1295us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842087.617243:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787842087.617481:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787842087.617488:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7235a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874687877549440:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787842087.617504:0:15054:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787842087.617532:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7235a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874687877549440:12345-0@lo:8:kworker.0 Request processed in 44us (1712us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787842087.617537:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787842087.617579:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787842087.617590:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787842087.617594:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877549440:0@lo:8:kworker.0 00010000:00080000:2.0:1787842087.617624:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464884c7480 x1874687877549312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787842107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787842087.617636:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787842087.617642:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787842087.617649:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787842087.617654:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787842087.617656:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946486703800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787842087.617674:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787842087.617677:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877549312:0@lo:8:kworker.0 00000004:00080000:3.0:1787842087.618602:0:14391:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787842087.618624:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1874687877549952:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787842087.618672:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842087.618695:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b300 going to sleep for 11 seconds 00000004:00080000:3.0:1787842087.618710:0:14390:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787842087.619148:0:14390:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 476593690521ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787842087.619169:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787842087.619179:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877549824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787842087.619245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842087.619536:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549952 00000100:00100000:2.0:1787842087.619543:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549952 00000100:00100000:2.0:1787842087.619586:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787842087.619594:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14391:x1874687877549952:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1787842087.621132:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787842087.629872:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877549824 00000100:00100000:3.0:1787842087.629887:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877549824 00000100:00100000:3.0:1787842087.629964:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787842087.629975:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874687877549824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787842087.630035:0:15056:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787842087.635709:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874687877549824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5725us (16451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842087.635723:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787842087.635923:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94638226cf00 x1874687877549824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787842103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787842087.635955:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877549824:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787842087.645662:0:15053:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787842087.645675:0:15053:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787842087.645681:0:15053:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1787842087.660607:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787842087.660621:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660640:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1787842087.660645:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842087.660652:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660682:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660693:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660701:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660721:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.660736:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.660742:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660749:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfe00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.660753:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660762:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660778:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660787:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9bec4a9/0x1d0ed3605e13706f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.660815:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.660817:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.660819:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787842087.661307:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787842087.661313:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661322:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1787842087.661325:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842087.661328:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661337:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661344:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661351:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661369:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.661380:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.661385:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661405:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dea00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.661408:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661416:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661427:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661434:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f70f02a/0x1d0ed3605e137076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661448:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.661450:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.661451:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787842087.661874:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787842087.661880:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.661889:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1787842087.661893:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842087.663598:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663617:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663641:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663649:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663667:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.663681:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.663686:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663694:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.663699:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663708:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663725:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663733:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a2c59b/0x1d0ed3605e13707d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.663756:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.663763:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.663765:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787842087.666942:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787842087.666957:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.666976:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1787842087.666981:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842087.666989:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667004:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667015:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667022:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667055:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787842087.667790:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787842087.667798:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667810:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1787842087.667814:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842087.667818:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667836:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667846:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667854:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667874:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787842087.667890:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787842087.667924:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667933:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.667938:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667947:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667965:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667971:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aeb7686/0x1d0ed3605e137084 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.667999:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.668002:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.668008:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.668011:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.668018:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.668027:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.668034:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfdc638b/0x1d0ed3605e13708b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.668045:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.668764:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.668766:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.668887:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842087.670604:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842087.670620:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.670639:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787842087.670644:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842087.670651:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.670668:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.670680:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.671402:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.671448:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.671534:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.671543:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.671553:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.671566:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.671577:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.671597:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.671605:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a5ec76/0x1d0ed3605e137092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.671628:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.671630:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.671632:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842087.673297:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842087.673309:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673326:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787842087.673331:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842087.673338:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673353:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673363:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673372:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673399:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787842087.673435:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842087.673444:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.673453:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842087.673481:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.673493:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.673524:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.673532:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117adb39/0x1d0ed3605e137099 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.673552:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.673554:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.673556:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842087.673930:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842087.673938:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673948:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787842087.673959:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842087.673964:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673975:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673984:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.673991:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674012:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.674134:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.674142:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.674150:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.674154:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.674162:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.674174:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.674190:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7b051c/0x1d0ed3605e1370a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.674209:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.674212:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.674215:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842087.674591:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842087.674598:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674609:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787842087.674613:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842087.674617:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674628:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674636:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674650:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674668:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842087.674680:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842087.674685:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674692:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.674696:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674706:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674718:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674727:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e1370a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.674744:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.674746:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.674748:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787842087.674848:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787842087.675915:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.675923:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.675946:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.675950:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.675956:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.675969:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.675978:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.675985:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.676006:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787842087.676660:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.676668:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.676678:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.676681:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.676686:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.676694:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.676713:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.676720:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.676738:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787842087.677162:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.677169:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677178:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.677181:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.677185:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677194:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677201:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677207:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677226:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787842087.677248:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787842087.677264:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677273:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247c00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.677277:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677287:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677303:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677311:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa135b66/0x1d0ed3605e1370ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677329:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787842087.677334:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677340:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.677344:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677352:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677376:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677383:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c117acc/0x1d0ed3605e1370b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677394:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842087.677397:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677403:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.677406:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677413:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677421:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677428:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e1370bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.677439:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.677440:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.677451:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.677843:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.677850:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677859:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.677862:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.677867:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677876:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677883:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677889:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.677922:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.678151:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.678158:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.678166:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.678169:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.678176:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.678188:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.678194:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e1370c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.678208:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.678209:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.678211:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.678767:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.678775:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.678785:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.678795:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.678800:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.678811:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.678819:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.678826:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.679067:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787842087.679695:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.679702:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.679713:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.679717:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.679722:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.679732:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.679740:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.679755:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683251:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787842087.683277:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683293:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.683298:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683310:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683333:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683341:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e1370ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683365:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.683370:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683377:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.683380:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683388:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683418:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.683427:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.683429:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.683431:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.685623:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.691121:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787842087.691137:0:15053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e1370d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787842087.692149:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.692161:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692177:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.692182:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.692188:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692203:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692213:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692221:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692250:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787842087.692651:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.692657:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692665:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.692668:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.692673:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692682:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692689:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692697:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.692706:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787842087.693085:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.693091:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693099:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.693108:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.693113:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693121:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693129:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693136:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693143:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787842087.693555:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.693561:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693570:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.693574:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.693578:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693586:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693594:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693607:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.693616:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787842087.697110:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787842087.697125:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697140:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.697146:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697158:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697182:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697190:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e1370d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697210:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787842087.697214:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697220:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.697223:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697242:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697254:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697262:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a41e05ed/0x1d0ed3605e1370df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697274:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787842087.697278:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697284:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.697288:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697294:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697303:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697310:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed44ecd3/0x1d0ed3605e1370e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697333:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842087.697337:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697344:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.697347:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697355:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697365:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697372:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000355cb747/0x1d0ed3605e1370ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.697383:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.697385:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.697387:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842087.699375:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.706046:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.706065:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.706083:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.706089:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.706097:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.706115:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.706126:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.706133:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.706153:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842087.709083:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842087.709095:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.709110:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842087.709127:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.709141:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.709168:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.709176:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7328ae9/0x1d0ed3605e1370f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842087.709199:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.709201:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842087.709203:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.710091:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.710101:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710120:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.710125:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.710131:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710143:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710152:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710159:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710179:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787842087.710194:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842087.710199:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710207:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246c00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842087.710211:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710221:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710246:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.710254:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f5ff050/0x1d0ed3605e1370fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.712196:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.712199:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.712201:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.713251:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.714950:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.714978:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.714983:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.714990:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.715008:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.715018:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.715026:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.715063:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787842087.718283:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.718301:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718319:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.718324:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.718330:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718345:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718356:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718364:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718387:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787842087.718407:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787842087.718414:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718421:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842087.718433:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718442:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718493:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718501:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d29bb085/0x1d0ed3605e137102 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718642:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842087.718645:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718653:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842087.718656:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718664:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718674:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718681:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd1be266/0x1d0ed3605e137109 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.718699:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.718701:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.718704:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.719207:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.719214:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719224:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.719228:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.719232:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719241:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719248:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719255:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719360:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787842087.719371:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842087.719375:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719396:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842087.719400:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719408:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719419:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719426:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000634d08c0/0x1d0ed3605e137110 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.719440:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.719442:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.719443:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.719984:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.719991:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720000:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.720003:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.720007:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720016:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720031:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720039:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720053:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787842087.720063:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787842087.720067:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720073:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842087.720077:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720085:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720096:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720104:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000797b92f0/0x1d0ed3605e137117 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.720119:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.720126:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842087.720127:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.722042:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.722053:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.722067:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.722071:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.722077:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.722090:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.722100:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.722108:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.722136:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.723256:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.723341:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.723355:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.723360:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.723371:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.723390:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.723398:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ce21d74/0x1d0ed3605e13711e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.723421:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.723423:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.723424:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842087.723623:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787842087.726417:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842087.726434:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.726453:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787842087.727779:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842087.727790:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.727819:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.727831:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.727839:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842087.727863:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787842087.728788:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842087.728797:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.728807:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842087.728812:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.728822:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.728840:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.728847:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af81e749/0x1d0ed3605e137125 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842087.728866:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.728867:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842087.728869:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787842087.729013:0:15053:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787842087.729158:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14391:x1874687877549952:12345-0@lo:5:osp-pre-0-0.0 Request processed in 109560us (110480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842087.729172:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787842087.737978:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1874687877549952:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787842087.738007:0:14391:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787842087.738086:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1874687877550080:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787842087.738155:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842087.738217:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485df4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787842087.739437:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550080 00000100:00100000:2.0:1787842087.739450:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550080 00000100:00100000:2.0:1787842087.739536:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787842087.739547:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14391:x1874687877550080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787842087.739606:0:15054:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787842087.763801:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14391:x1874687877550080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24246us (25636us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787842087.763818:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787842087.763908:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1874687877550080:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787842087.763925:0:14391:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:0.0:1787842087.773348:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787842088.497632:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842089.526287:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842090.546306:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842091.571817:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842092.594680:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842092.788852:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877550336:0@lo:400:kworker.0 00000100:00100000:1.0:1787842092.788937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842092.788993:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787842092.789000:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877550208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787842092.789093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787842092.789098:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787842092.789101:0:37:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787842092.789106:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1787842092.789111:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787842092.789119:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464871f3800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842092.789139:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464884c6940 x1874687877550592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787842092.789289:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877550848:0@lo:400:kworker.0 00000100:00100000:0.0:1787842092.789339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.789397:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877550720:0@lo:400:kworker.0 00000100:00100000:0.0:1787842092.789423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.789442:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787842092.789447:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877550464:0@lo:400:kworker.0 00000100:00100000:3.0:1787842092.789603:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550336 00000100:00100000:3.0:1787842092.789611:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550336 00000100:00100000:3.0:1787842092.789783:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787842092.789794:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:3309:x1874687877550336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842092.789858:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:3309:x1874687877550336:12345-0@lo:400:kworker.0 Request processed in 66us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842092.789866:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787842092.790391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.790430:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877550592:0@lo:8:kworker.0 00000100:00100000:1.0:1787842092.790886:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842092.790923:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877550336:0@lo:400:kworker.0 00000100:00100000:1.0:1787842092.790981:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550208 00000100:00100000:1.0:1787842092.790987:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550208 00000100:00100000:3.0:1787842092.793221:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550464 00000100:00100000:3.0:1787842092.793244:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550464 00000100:00100000:3.0:1787842092.793302:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787842092.793312:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874687877550464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842092.793401:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874687877550464:12345-0@lo:400:kworker.0 Request processed in 91us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842092.793409:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787842092.793507:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877550464:0@lo:400:kworker.0 00000100:00100000:1.0:1787842092.793900:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842092.793921:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877550208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787842092.793965:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787842092.794095:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877550208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842092.794101:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842092.794151:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877550208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787842092.802666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.802747:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550848 00000100:00100000:0.0:1787842092.802755:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550848 00000100:00100000:0.0:1787842092.802808:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550720 00000100:00100000:0.0:1787842092.802812:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550720 00000100:00100000:0.0:1787842092.802829:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842092.802839:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877550848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842092.802934:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877550848:12345-0@lo:400:kworker.0 Request processed in 97us (13594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842092.802941:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842092.802970:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787842092.802977:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877550720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842092.803012:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877550720:12345-0@lo:400:kworker.0 Request processed in 36us (13588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842092.803018:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787842092.803037:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787842092.803041:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787842092.805618:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550592 00000100:00100000:3.0:1787842092.805644:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550592 00000100:00100000:3.0:1787842092.805696:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787842092.805705:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874687877550592:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787842092.805727:0:15054:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787842092.820422:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464884c7840 x1874687877550848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842092.820487:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877550848:0@lo:400:kworker.0 00010000:00080000:0.0:1787842092.820551:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464884c4000 x1874687877550720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842092.820561:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877550720:0@lo:400:kworker.0 00000100:00100000:2.0:1787842092.857616:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1874687877550592:12345-0@lo:8:kworker.0 Request processed in 51903us (54948us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787842092.858087:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787842092.858151:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787842092.858159:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787842092.858163:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877550592:0@lo:8:kworker.0 00000020:01000004:2.0:1787842092.865925:0:15770:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787842092.865929:0:15770:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787842092.866121:0:15770:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9464b7fc7800 00000020:01000004:2.0:1787842092.866139:0:15770:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787842092.866152:0:15770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787842092.866166:0:15770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9464870b4ed8) 00000020:00000080:2.0:1787842092.866183:0:15770:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787842092.904394:0:15770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787842092.907429:0:15770:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787842092.909119:0:15770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787842092.909425:0:15770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787842092.910035:0:15770:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787842092.910612:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 241: rc = 0 00100000:10000000:2.0:1787842092.913132:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 241: rc = 0 00100000:10000000:2.0:1787842092.913289:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 241: rc = 0 00100000:10000000:2.0:1787842092.913942:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787842092.914187:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787842092.914444:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787842092.914727:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1787842092.915007:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1787842092.915264:0:15770:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00000020:00000080:2.0:1787842092.916791:0:15770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787842092.916804:0:15770:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787842092.916816:0:15770:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d0ed3605e137133 00000020:01000004:2.0:1787842092.916824:0:15770:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787842092.916860:0:15770:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787842092.916864:0:15770:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787842092.916870:0:15770:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787842092.917010:0:15770:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787842092.917015:0:15770:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787842092.934812:0:15770:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787842092.934863:0:15770:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.146@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787842092.934868:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787842092.934870:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787842092.934871:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842092.934872:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842092.934873:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842092.934874:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842092.934876:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787842092.934878:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842092.934879:0:15770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787842092.934883:0:15770:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787842092.934885:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787842092.934886:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787842092.934887:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787842092.934888:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787842092.934889:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787842092.934890:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787842092.934891:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787842092.935292:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787842092.935293:0:15770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787842092.935327:0:15770:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787842092.935348:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877550976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787842092.935434:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842092.935619:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464893e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842092.935836:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877550976 00000100:00100000:0.0:1787842092.935854:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877550976 00000100:00100000:0.0:1787842092.936015:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787842092.936027:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15770:x1874687877550976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787842092.936062:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787842092.936066:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787842092.936069:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787842092.946555:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15770:x1874687877550976:12345-0@lo:253:mount.lustre.0 Request processed in 10520us (11110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842092.946572:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787842092.946741:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877550976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787842092.946758:0:15770:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787842092.946761:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787842092.946763:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787842092.946764:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787842092.946766:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787842092.946767:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787842092.946768:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787842092.946770:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787842092.946772:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787842092.946773:0:15770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787842092.947879:0:15770:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464b7fc7800 from lustre-OST0001 10000000:01000000:1.0:1787842092.947915:0:15770:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787842092.947918:0:15770:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787842092.947926:0:15770:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9463826dced8 local copy 00010000:00010000:1.0:1787842092.947936:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842092.948268:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787842092.948334:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842092.948376:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787842092.953250:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551104 00000100:00100000:2.0:1787842092.953268:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551104 00000100:00100000:2.0:1787842092.953334:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787842092.953346:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15770:x1874687877551104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842092.953763:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15770:x1874687877551104:12345-0@lo:501:mount.lustre.0 Request processed in 418us (5427us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787842092.953773:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787842092.954386:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551104:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787842092.954415:0:15770:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787842092.954634:0:15770:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787842092.954647:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842092.954658:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6df200/0x1d0ed3605e136ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e136ee7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787842092.954689:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9464b7fc7800 10000000:01000000:1.0:1787842092.954694:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787842092.954700:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787842092.954709:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787842092.954714:0:15770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787842092.954718:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787842092.954753:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842092.954761:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842092.954771:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842092.954794:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787842092.954852:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842092.955069:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787842092.955164:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551232 00000100:00100000:2.0:1787842092.955171:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551232 00000100:00100000:2.0:1787842092.955222:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787842092.955232:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:15770:x1874687877551232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787842092.955245:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842092.955260:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e13713a expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842092.955286:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e13713a expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842092.955299:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6de600/0x1d0ed3605e137141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e13713a expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842092.955308:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de600, rc 0) 00000100:00100000:2.0:1787842092.955354:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551232:12345-0@lo:101:mount.lustre.0 Request processed in 123us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842092.955371:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787842092.955565:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787842092.955581:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137141 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842092.955589:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e137141 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787842092.956361:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787842092.959579:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787842092.959871:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787842092.960088:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787842092.960124:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787842092.960173:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787842092.960286:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787842092.960329:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787842092.960430:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787842092.960438:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787842092.960732:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787842092.960798:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842092.961926:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787842092.963656:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551360 00000100:00100000:0.0:1787842092.963672:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551360 00000100:00100000:0.0:1787842092.963735:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787842092.963745:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842092.964386:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551360:12345-0@lo:501:mount.lustre.0 Request processed in 641us (3585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842092.964403:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787842092.964506:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842092.964564:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787842092.964610:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.964640:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787842092.964657:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551488 00000100:00100000:0.0:1787842092.964661:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551488 00000100:00100000:0.0:1787842092.964689:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787842092.964696:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787842092.964979:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551488:12345-0@lo:503:mount.lustre.0 Request processed in 283us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842092.964987:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787842092.965022:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787842092.965809:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787842092.965898:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787842092.965947:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.965971:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787842092.965989:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551616 00000100:00100000:0.0:1787842092.965994:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551616 00000100:00100000:0.0:1787842092.966021:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787842092.966029:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787842092.966194:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551616:12345-0@lo:502:mount.lustre.0 Request processed in 165us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842092.966201:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787842092.966258:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787842092.966482:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787842092.966529:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787842092.966565:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787842092.966613:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787842092.966647:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787842092.966675:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787842092.966711:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787842092.966740:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787842092.966779:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787842092.966801:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787842092.966834:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.970193:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787842092.970303:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551744 00000100:00100000:1.0:1787842092.970313:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551744 00000100:00100000:1.0:1787842092.970401:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787842092.970412:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787842092.970694:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551744:12345-0@lo:502:mount.lustre.0 Request processed in 283us (3858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842092.970702:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787842092.971151:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787842092.971283:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787842092.971300:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787842092.973541:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787842092.973554:0:15773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787842092.973561:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842092.973563:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787842092.973569:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787842092.973587:0:15773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff946484e61a48) 00000020:00000080:3.0:1787842092.973613:0:15773:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787842092.973619:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787842092.973686:0:15773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464b7fc7800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787842092.973694:0:15773:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787842092.973701:0:15773:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1d0ed3605e13714f 00010000:00010000:3.0:1787842092.980418:0:15773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787842092.981094:0:15773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787842092.983770:0:15773:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787842092.985547:0:15773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787842092.985561:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842092.985578:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842092.985581:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787842092.985585:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842092.985589:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842092.985590:0:15773:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787842092.985593:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787842092.985595:0:15773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787842092.985597:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842092.985599:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842092.985600:0:15773:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787842092.985603:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842092.985605:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842092.985606:0:15773:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787842092.985609:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787842092.985679:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842092.985684:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842092.985686:0:15773:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787842092.985690:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787842092.990175:0:15770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787842092.990354:0:15770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787842092.990372:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137141 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.990387:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464a7246400/0x1d0ed3605e13713a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137141 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842092.990395:0:15770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464b7fc7800 from 1 10000000:01000000:0.0:1787842092.990398:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787842092.990439:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.990632:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.990644:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842092.990671:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787842092.990750:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.990783:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787842092.990803:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877551872 00000100:00100000:0.0:1787842092.990809:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877551872 00000100:00100000:0.0:1787842092.990865:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787842092.990874:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:15770:x1874687877551872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787842092.990887:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842092.990909:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e137156 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.990932:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.990943:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.990951:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485480800, rc 0) 00000100:00100000:0.0:1787842092.991052:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877551872:12345-0@lo:101:mount.lustre.0 Request processed in 177us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842092.991058:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787842092.991110:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877551872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787842092.991125:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842092.991134:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787842092.991721:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000001:00080000:3.0:1787842092.995555:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000040:00080000:0.0:1787842092.995889:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787842092.996616:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787842092.996673:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787842092.996743:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787842092.996751:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787842092.996866:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787842092.997063:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842092.997313:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842093.000072:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552000 00000100:00100000:3.0:1787842093.000090:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552000 00000100:00100000:3.0:1787842093.000868:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787842093.000880:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842093.001418:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552000:12345-0@lo:501:mount.lustre.0 Request processed in 540us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842093.001428:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787842093.001637:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787842093.001697:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787842093.001751:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842093.002128:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464893e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842093.002169:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552128 00000100:00100000:0.0:1787842093.002177:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552128 00000100:00100000:0.0:1787842093.002319:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787842093.002329:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787842093.002839:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552128:12345-0@lo:503:mount.lustre.0 Request processed in 511us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842093.002857:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787842093.003079:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787842093.004184:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787842093.004353:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787842093.004418:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842093.004784:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ceb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842093.004822:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552256 00000100:00100000:3.0:1787842093.004829:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552256 00000100:00100000:3.0:1787842093.005036:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787842093.005048:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842093.005432:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552256:12345-0@lo:502:mount.lustre.0 Request processed in 386us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842093.005448:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787842093.005719:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787842093.006156:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787842093.006287:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787842093.006341:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787842093.006383:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787842093.006420:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787842093.007346:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787842093.007414:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787842093.007811:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787842093.007876:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842093.008098:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842093.008151:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464812edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842093.008215:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552384 00000100:00100000:2.0:1787842093.008223:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552384 00000100:00100000:2.0:1787842093.008274:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787842093.008284:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787842093.008745:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552384:12345-0@lo:502:mount.lustre.0 Request processed in 460us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842093.008754:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787842093.008857:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787842093.009127:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787842093.009142:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787842093.010201:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842093.010218:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842093.010221:0:15777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787842093.010228:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464b7fc7800 00000020:00000080:3.0:1787842093.010230:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787842093.010237:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842093.010240:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842093.010242:0:15777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787842093.010244:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842093.010247:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842093.010248:0:15777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787842093.010251:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464b7fc7800 00000020:00000080:3.0:1787842093.010252:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787842093.010309:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842093.010313:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842093.010314:0:15777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787842093.010316:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787842093.010318:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842093.010319:0:15777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787842093.010322:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9464b7fc7800 00000020:00000080:3.0:1787842093.010337:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787842093.010377:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787842093.010381:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787842093.010382:0:15777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787842093.010385:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787842093.014124:0:15770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787842093.014175:0:15770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787842093.014196:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842093.014209:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842093.014265:0:15770:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787842093.014276:0:15770:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9464b7fc7800 10000000:01000000:2.0:1787842093.014279:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9464b7fc7800 10000000:01000000:2.0:1787842093.014284:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787842093.014290:0:15770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9464b7fc7800 from 1 10000000:01000000:2.0:1787842093.014293:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787842093.014331:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842093.014339:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842093.014349:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842093.014370:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787842093.014435:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842093.014502:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff946485ceb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787842093.016166:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552512 00000100:00100000:3.0:1787842093.016178:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552512 00000100:00100000:3.0:1787842093.016233:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787842093.016243:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877552512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842093.016259:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842093.016276:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c46c00/0x1d0ed3605e13716b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e137164 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842093.016302:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c46c00/0x1d0ed3605e13716b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e137164 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842093.016313:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c46c00/0x1d0ed3605e13716b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137164 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842093.016322:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46c00, rc 0) 00000100:00100000:3.0:1787842093.016385:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552512:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842093.016392:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787842093.016446:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72352c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787842093.016482:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13716b expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842093.016493:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e13716b expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787842093.018368:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787842093.018750:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787842093.019670:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787842093.019728:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787842093.019765:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787842093.019812:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787842093.019863:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787842093.021762:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787842093.021837:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787842093.021888:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787842093.022700:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787842093.022739:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787842093.022796:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787842093.024398:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787842093.026130:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787842093.026221:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787842093.026302:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787842093.026341:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787842093.026378:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787842093.026428:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787842093.026486:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787842093.026523:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787842093.026573:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787842093.026625:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787842093.026658:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787842093.026707:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787842093.026748:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787842093.026783:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787842093.026868:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787842093.026909:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787842093.026943:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787842093.027257:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787842093.027296:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787842093.027333:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787842093.027368:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787842093.027419:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787842093.027497:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787842093.027550:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787842093.027585:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787842093.027680:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787842093.027688:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787842093.027786:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842093.027867:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842093.027912:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464812edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842093.028122:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552640 00000100:00100000:2.0:1787842093.028130:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552640 00000100:00100000:2.0:1787842093.028184:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787842093.028195:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787842093.028477:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552640:12345-0@lo:501:mount.lustre.0 Request processed in 261us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842093.028485:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787842093.030442:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787842093.030535:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787842093.030619:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842093.030664:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464812edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787842093.032072:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552768 00000100:00100000:2.0:1787842093.032084:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552768 00000100:00100000:2.0:1787842093.032132:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787842093.032141:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787842093.032580:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552768:12345-0@lo:503:mount.lustre.0 Request processed in 438us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842093.032596:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787842093.033067:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787842093.033702:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787842093.033783:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842093.033858:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842093.037303:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787842093.037554:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877552896 00000100:00100000:2.0:1787842093.037564:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877552896 00000100:00100000:2.0:1787842093.037628:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787842093.037638:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787842093.038055:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877552896:12345-0@lo:502:mount.lustre.0 Request processed in 418us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842093.038064:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787842093.038341:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877552896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787842093.038725:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787842093.038784:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787842093.038818:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787842093.042060:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787842093.042183:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787842093.042604:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787842093.042653:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787842093.042686:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787842093.042738:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787842093.042776:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787842093.042811:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787842093.042872:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787842093.045357:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787842093.045443:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787842093.046150:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787842093.046198:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787842093.046425:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787842093.046601:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787842093.046642:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787842093.046681:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787842093.046734:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787842093.046766:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787842093.046792:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787842093.046830:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787842093.046874:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787842093.046913:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787842093.046954:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787842093.049191:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787842093.049798:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787842093.050298:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787842093.050351:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787842093.050389:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787842093.051284:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787842093.051382:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787842093.051423:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787842093.052111:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787842093.052158:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787842093.058208:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787842093.058308:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787842093.058350:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787842093.058407:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877553024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842093.058531:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842093.058583:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464812edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787842093.058638:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553024 00000100:00100000:3.0:1787842093.058646:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553024 00000100:00100000:3.0:1787842093.058700:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787842093.058710:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877553024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787842093.058998:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877553024:12345-0@lo:502:mount.lustre.0 Request processed in 288us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842093.059006:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787842093.059069:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877553024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787842093.059147:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787842093.059158:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787842093.064096:0:15782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787842093.064141:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff946383d39a48) 00000020:00000080:0.0:1787842093.064170:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787842093.064286:0:15782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464b7fc7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787842093.064292:0:15782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9464b7fc7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787842093.064295:0:15782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9464b7fc7800 3 00010000:00080000:0.0:1787842093.064343:0:15782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946381c48800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.146@tcp at head 00010000:00010000:0.0:1787842093.066086:0:15782:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787842093.066806:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787842093.067378:0:15782:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787842093.067396:0:15782:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1d0ed3605e137179 00000100:00080000:0.0:1787842093.067409:0:15782:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787842093.067417:0:15782:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946381c48800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842093.069618:0:15782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464884c7840 x1874687877553152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787842093.069652:0:15782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787842093.069782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787842093.069788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787842093.069792:0:37:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787842093.069798:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:1.0:1787842093.069802:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787842093.069809:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464871f3800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:1.0:1787842093.069831:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94638291f480 x1874687877553408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787842093.070052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877553280:0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.070141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842093.070277:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877553664:0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.070311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842093.070332:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787842093.070337:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877553536:0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.070359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842093.070391:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553664 00000100:00100000:0.0:1787842093.070398:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553664 00000100:00100000:0.0:1787842093.070448:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553536 00000100:00100000:0.0:1787842093.070451:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553536 00000100:00100000:0.0:1787842093.070571:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787842093.070580:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877553664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.070638:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877553664:12345-0@lo:400:kworker.0 Request processed in 58us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842093.070645:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787842093.070663:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787842093.070669:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877553536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.070707:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877553536:12345-0@lo:400:kworker.0 Request processed in 38us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842093.070713:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787842093.070757:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94638291ed00 x1874687877553536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842093.070769:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877553536:0@lo:400:kworker.0 00010000:00080000:0.0:1787842093.070780:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94638291cb40 x1874687877553664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842093.070788:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877553664:0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.071056:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874687877553152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787842093.071089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842093.071126:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877553408:0@lo:8:kworker.0 00000100:00100000:0.0:1787842093.071149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842093.071199:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553280 00000100:00100000:0.0:1787842093.071204:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553280 00000100:00100000:3.0:1787842093.071328:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553408 00000100:00100000:3.0:1787842093.071333:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553408 00000100:00100000:3.0:1787842093.071357:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787842093.071364:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1874687877553408:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787842093.071424:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1874687877553408:12345-0@lo:8:kworker.0 Request processed in 59us (273us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787842093.071431:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787842093.071766:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553152 00000100:00100000:1.0:1787842093.071770:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553152 00000100:00100000:1.0:1787842093.071794:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787842093.071800:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1874687877553152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787842093.071817:0:14370:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1787842093.071869:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1d0ed3605e137180 00000004:00100000:1.0:1787842093.071887:0:14370:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787842093.071934:0:14370:0:(import.c:65:import_set_state_nolock()) ffff94649c2b5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787842093.072138:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787842093.072148:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877553280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.072195:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877553280:12345-0@lo:400:kworker.0 Request processed in 48us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842093.072201:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787842093.072309:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874687877553152:12345-0@lo:38:llog_process_th.0 Request processed in 508us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842093.072316:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787842093.072404:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464884c7840 x1874687877553152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787842103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842093.072414:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787842093.072421:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787842093.072438:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787842093.072443:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787842093.072446:0:3305:0:(import.c:65:import_set_state_nolock()) ffff946381c48800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787842093.072578:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787842093.072595:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877553280:0@lo:400:kworker.0 00000100:00100000:0.0:1787842093.072697:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1874687877553152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787842093.072715:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787842093.072720:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787842093.072723:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787842093.072726:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877553408:0@lo:8:kworker.0 00000040:00080000:0.0:1787842093.072947:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787842093.073303:0:15770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787842093.073333:0:15770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787842093.073357:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13716b expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842093.073386:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6df400/0x1d0ed3605e137164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13716b expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787842093.073430:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787842093.073432:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787842093.073434:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787842093.073435:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787842093.073436:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787842093.073438:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787842093.073439:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787842093.073442:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787842093.073443:0:15770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787842093.073446:0:15770:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787842093.073448:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787842093.073450:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787842093.073451:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787842093.073488:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787842093.073490:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787842093.073491:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787842093.073492:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787842093.073493:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787842093.073495:0:15770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787842093.073519:0:15770:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787842093.073538:0:15770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877553792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787842093.073591:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842093.073629:0:15770:0:(client.c:2715:ptlrpc_set_wait()) set ffff94649010f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787842093.074081:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553792 00000100:00100000:2.0:1787842093.074089:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553792 00000100:00100000:2.0:1787842093.074130:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787842093.074139:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:15770:x1874687877553792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787842093.074168:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787842093.074184:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787842093.116110:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787842093.116131:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787842093.116304:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787842093.116310:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787842093.116336:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842093.116356:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842093.116364:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842093.116409:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842093.116423:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 19 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842093.116483:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1874687877553920:0@lo:104: 00000100:00100000:1.0:1787842093.116557:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842093.116601:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a3d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787842093.116728:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877553920 00000100:00100000:3.0:1787842093.116735:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877553920 00000100:00100000:3.0:1787842093.116790:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787842093.116800:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14384:x1874687877553920:12345-0@lo:104: 00010000:00010000:3.0:1787842093.116814:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842093.116906:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787842093.116913:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:14384:x1874687877553920:12345-0@lo:104: Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842093.116921:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787842093.116972:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1874687877553920:0@lo:104: 00010000:00010000:3.0:1787842093.116993:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117191:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842093.117199:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117213:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481e00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:0.0:1787842093.117218:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117225:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787842093.117232:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842093.117237:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787842093.117271:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117290:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787842093.117312:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117319:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485481e00/0x1d0ed3605e13705a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e137061 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117338:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842093.117341:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842093.117343:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842093.117355:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877554048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787842093.117391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842093.117439:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554048 00000100:00100000:0.0:1787842093.117444:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554048 00010000:00010000:0.0:1787842093.117642:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 20 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842093.117670:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787842093.117678:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+20:3308:x1874687877554048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842093.117692:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842093.117697:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 20 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117708:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 20 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117723:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946383c47400/0x1d0ed3605e137061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e13705a expref: 20 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117748:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117756:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787842093.117771:0:14355:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001461227s 00010000:00010000:0.0:1787842093.117775:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117782:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117789:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117796:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117801:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246000 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842093.117805:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117814:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117828:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.117838:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787842093.117887:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3308:x1874687877554048:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842093.117906:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787842093.117942:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877554048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842093.118088:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.118096:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842093.118101:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464a7246000/0x1d0ed3605e137187 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842093.127583:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:15770:x1874687877553792:12345-0@lo:253:mount.lustre.0 Request processed in 53307us (53854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842093.127602:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787842093.127768:0:15770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638226de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5153086-f7d7-4317-94f4-d9c880bce3b9:15770:1874687877553792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787842093.127785:0:15770:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787842093.127789:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787842093.127790:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787842093.127792:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787842093.127793:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787842093.127794:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787842093.127796:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787842093.127797:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787842093.127799:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787842093.127801:0:15770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787842093.127816:0:15770:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787842093.133324:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787842093.133685:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787842093.133863:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787842093.134105:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787842093.134384:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787842093.135773:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787842093.138071:0:15770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787842093.195134:0:15770:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787842093.195145:0:15770:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787842093.195190:0:15770:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787842093.195337:0:15770:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787842093.195352:0:15770:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787842093.195384:0:15770:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787842093.617877:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842094.641693:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787842094.900201:0:14366:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787842094.900210:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9464bfa16800 from 8 10000000:01000000:2.0:1787842094.900215:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787842094.900271:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842094.900283:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842094.900295:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842094.900325:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877554176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787842094.900402:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842094.900495:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787842094.903308:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554176 00000100:00100000:3.0:1787842094.903323:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554176 00000100:00100000:3.0:1787842094.903389:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787842094.903400:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877554176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842094.903421:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842094.903473:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c47800/0x1d0ed3605e137195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e13718e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842094.903505:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c47800/0x1d0ed3605e137195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e13718e expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842094.903516:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c47800/0x1d0ed3605e137195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e13718e expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842094.903526:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47800, rc 0) 00000100:00100000:3.0:1787842094.903602:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877554176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842094.903609:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787842094.903729:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877554176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787842094.903749:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137195 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842094.903759:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e137195 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842094.903845:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877554304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787842094.903891:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842094.903930:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464871e4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787842094.904936:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554304 00000100:00100000:3.0:1787842094.904947:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554304 00000100:00100000:3.0:1787842094.904994:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787842094.905004:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877554304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787842094.905026:0:14362:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787842094.905048:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787842094.905051:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000040:00080000:1.0:1787842094.905206:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787842094.906271:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877554304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1264us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842094.906290:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787842094.906871:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877554304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787842094.906947:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787842094.906959:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137195 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842094.906970:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff94648a6de800/0x1d0ed3605e13718e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137195 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842095.671763:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842096.691514:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842097.713717:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842097.906076:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877554432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787842097.906151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842097.909732:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554432 00000100:00100000:0.0:1787842097.909760:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554432 00000100:00100000:0.0:1787842097.909847:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787842097.909858:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877554432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787842097.909895:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787842097.909998:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877554432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842097.910004:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787842097.910060:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877554432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787842097.910782:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787842098.418443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787842098.418450:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787842098.418479:0:8:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787842098.418493:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9464871f3800 using connection 192.168.202.146@tcp/0@lo 00000100:00100000:0.0:1787842098.418520:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94649197f480 x1874687877554816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787842098.418583:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877554688:0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.418660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.418734:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787842098.418741:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5153086-f7d7-4317-94f4-d9c880bce3b9:3307:1874687877554560:0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.418775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.418809:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877555200:0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.418839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.418869:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877554816:0@lo:8:kworker.0 00000100:00100000:0.0:1787842098.418899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.418929:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877554944:0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.418949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.418966:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787842098.418971:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877555072:0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.418989:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.419016:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554688 00000100:00100000:0.0:1787842098.419022:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554688 00000100:00100000:0.0:1787842098.419065:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554816 00000100:00100000:0.0:1787842098.419069:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554816 00000100:00100000:0.0:1787842098.419084:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787842098.419100:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877554688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.419150:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877554688:12345-0@lo:400:kworker.0 Request processed in 52us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842098.419158:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787842098.419174:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842098.419179:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1874687877554816:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787842098.419203:0:15053:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787842098.419230:0:15053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1d0ed3605e13719c 00002000:00100000:0.0:1787842098.419247:0:15053:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff946381c4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787842098.419252:0:15053:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787842098.419254:0:15053:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787842098.419653:0:15053:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787842098.419678:0:15053:0:(import.c:65:import_set_state_nolock()) ffff946381c4a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787842098.419730:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874687877554816:12345-0@lo:8:kworker.0 Request processed in 549us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842098.419738:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842098.419761:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555200 00000100:00100000:0.0:1787842098.419765:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555200 00000100:00100000:0.0:1787842098.419813:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554944 00000100:00100000:0.0:1787842098.419816:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554944 00000100:00100000:0.0:1787842098.419832:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555072 00000100:00100000:0.0:1787842098.419835:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555072 00000100:00100000:0.0:1787842098.419851:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787842098.419859:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877555200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.419893:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877555200:12345-0@lo:400:kworker.0 Request processed in 36us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842098.419899:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787842098.419922:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787842098.419928:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877554944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.419963:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874687877554944:12345-0@lo:400:kworker.0 Request processed in 35us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842098.419969:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787842098.419980:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787842098.419986:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877555072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.420017:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877555072:12345-0@lo:400:kworker.0 Request processed in 31us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842098.420024:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787842098.420076:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980ed00 x1874687877555200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842098.420089:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877555200:0@lo:400:kworker.0 00000100:00100000:0.0:1787842098.420101:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877554688:0@lo:400:kworker.0 00010000:00080000:0.0:1787842098.420133:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649197f480 x1874687877554816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787842123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787842098.420144:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787842098.420152:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787842098.420156:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787842098.420159:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464871f3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787842098.420172:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787842098.420178:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1874687877554816:0@lo:8:kworker.0 00000100:00080000:0.0:1787842098.420197:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787842098.420215:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980d680 x1874687877555072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842098.420239:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877555072:0@lo:400:kworker.0 00010000:00080000:0.0:1787842098.420252:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649197e1c0 x1874687877554944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842098.420261:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874687877554944:0@lo:400:kworker.0 00000004:00080000:0.0:1787842098.420309:0:14393:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787842098.420328:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1874687877555456:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787842098.420358:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.420375:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648cba8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787842098.420387:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877555328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787842098.420407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.420430:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555456 00000100:00100000:0.0:1787842098.420433:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555456 00000100:00100000:0.0:1787842098.420479:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787842098.420485:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14393:x1874687877555456:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787842098.421979:0:14392:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787842098.422483:0:14392:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487397025690ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787842098.422862:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877554560 00000100:00100000:2.0:1787842098.422872:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877554560 00000100:00100000:2.0:1787842098.422924:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787842098.422933:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3307:x1874687877554560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787842098.423023:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3307:x1874687877554560:12345-0@lo:400:kworker.0 Request processed in 90us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842098.423031:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787842098.430570:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787842098.430595:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555328 00000100:00100000:1.0:1787842098.430604:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555328 00000100:00100000:1.0:1787842098.430664:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787842098.430673:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874687877555328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787842098.430713:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787842098.430806:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874687877555328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (10397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842098.430814:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787842098.431103:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b980d680 x1874687877555328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787842114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787842098.431126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877555328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787842098.431139:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5153086-f7d7-4317-94f4-d9c880bce3b9:3307:1874687877554560:0@lo:400:kworker.0 00002000:00080000:0.0:1787842098.432227:0:15053:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787842098.432237:0:15053:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787842098.432242:0:15053:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787842098.451581:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.451602:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451621:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.451626:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.451632:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451651:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451662:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451669:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451688:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.451700:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.451706:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451715:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.451719:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451729:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451755:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.451762:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.453390:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.453398:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.453401:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.454372:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.454383:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454401:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.454406:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.454413:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454429:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454439:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454447:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454496:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.454508:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.454514:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454522:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.454526:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454536:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454551:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454559:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.454578:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.454580:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.454582:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.475002:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.475018:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475036:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.475047:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.475054:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475070:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475081:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475089:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475107:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.475120:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.475125:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475134:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.475138:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475148:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475165:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475184:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475203:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.475205:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.475207:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.475667:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.475673:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475682:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.475686:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.475690:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475699:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475706:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475713:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475728:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.475737:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.475747:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475754:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.475757:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475766:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475777:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475784:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.475811:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.475812:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.475814:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.476201:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.476208:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476217:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.476220:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.476225:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476246:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476255:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476263:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476276:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.476285:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.476288:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476296:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.476299:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476308:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476319:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476327:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476347:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.476350:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.476352:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.476784:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.476803:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476811:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.476814:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.476818:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476828:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476836:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476844:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476859:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.476867:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.476870:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476888:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.476892:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476900:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476912:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476919:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.476934:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.476935:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.476937:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.477319:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.477325:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477334:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.477337:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.477341:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477350:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477363:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477369:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477382:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.477390:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.477393:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477400:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.477403:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477412:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477422:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477429:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.477441:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.477448:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.477450:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.487201:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.487215:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487233:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.487239:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.487246:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487262:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487483:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487494:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487513:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.487526:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.487532:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487540:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.487544:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487564:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487583:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487591:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e1371d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.487608:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.487610:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.487612:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.489757:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.489770:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.489796:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.489801:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.489808:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.489821:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.489831:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490051:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490073:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.490085:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.490091:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490100:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.490104:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490114:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490131:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490140:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a5ec76/0x1d0ed3605e1371db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.490157:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.490158:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.490160:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.491089:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.491104:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491117:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.491122:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.491127:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491138:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491148:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491157:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491172:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.491182:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.491186:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491194:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.491197:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491205:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491224:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491232:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3664602/0x1d0ed3605e1371e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.491247:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.491249:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.491251:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.492267:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.492989:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493007:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.493011:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.493017:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493031:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493042:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493050:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493087:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.493103:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.493109:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493118:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.493122:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493132:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493147:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493155:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000552e67ec/0x1d0ed3605e1371e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.493178:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.493180:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.493181:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.494838:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.496609:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496634:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.496648:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.496655:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496670:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496681:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496689:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496710:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.496729:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.496734:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496742:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.496746:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496755:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496771:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496802:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007909583e/0x1d0ed3605e1371f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.496825:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.496827:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.496829:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.501233:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.501249:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501271:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.501288:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.501294:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501312:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501322:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501330:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501348:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.501361:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.501373:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501549:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.501554:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501564:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501584:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501591:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c4ad12/0x1d0ed3605e1371f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.501615:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.501618:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.501621:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.502211:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.502218:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502229:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.502233:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.502238:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502260:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502270:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502279:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502296:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.502308:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.502312:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502320:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.502323:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502332:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502343:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502351:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a77b1b91/0x1d0ed3605e1371fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.502372:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.502374:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.502376:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.504800:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.504817:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.504836:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.504841:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.505120:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505141:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505478:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505488:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505539:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.505553:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.505558:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505579:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.505584:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505594:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505612:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505619:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b73715d/0x1d0ed3605e137205 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.505644:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.505646:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.505648:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.506809:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.506821:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.506835:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.506839:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.506846:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.506940:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.506956:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.506963:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.506983:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.506999:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.507004:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.507012:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.507017:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.507026:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.507043:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.507050:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006579c242/0x1d0ed3605e13720c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.507068:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.507075:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.507077:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.508061:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.508070:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508083:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.508087:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.508093:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508104:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508114:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508120:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508139:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.508440:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.508447:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508475:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.508479:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508501:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508517:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508525:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c953e04/0x1d0ed3605e137213 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.508546:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.508548:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.508549:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.517072:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.517089:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517107:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.517111:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.517118:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517132:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517142:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517215:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517233:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.517247:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.517253:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517261:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.517265:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517275:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517292:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517300:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e13721a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.517445:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.517447:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.517449:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.519092:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.519111:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519126:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.519131:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.519136:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519220:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519232:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519240:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519258:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.519270:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.519275:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519283:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.519287:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519297:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519477:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519485:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e137221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.519503:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.519505:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.519507:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787842098.529543:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787842098.530497:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.530510:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530530:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.530535:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.530542:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530559:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530571:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530580:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530607:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.530621:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.530627:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530635:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.530640:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530650:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.530669:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.531944:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d37380/0x1d0ed3605e137228 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.531972:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.531974:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.531976:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.535582:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.535598:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.535615:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.535626:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.535633:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.535647:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.535657:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.535666:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.538016:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.538036:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.538044:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.538058:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.538064:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.538077:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.538098:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.538120:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba0b436/0x1d0ed3605e13722f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.538145:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.538667:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.538908:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.544322:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.544335:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544353:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.544358:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.544366:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544382:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544393:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544401:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544417:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.544429:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.544441:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544450:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045800 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.544476:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544487:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544505:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544513:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52a4340/0x1d0ed3605e137236 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.544532:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.544535:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.544538:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.547019:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.547030:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547046:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.547050:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.547056:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547080:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547090:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547097:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547114:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.547126:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.547131:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547139:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.547143:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547152:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547168:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547175:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000584ef608/0x1d0ed3605e13723d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547199:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.547201:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.547203:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.547656:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.547661:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547670:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.547673:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.547676:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547685:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547692:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547699:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547712:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.547720:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.547724:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547741:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.547744:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547752:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547762:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547769:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000614ed409/0x1d0ed3605e137244 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.547782:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.547784:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.547795:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.548333:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.548340:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548351:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.548355:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.548360:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548371:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548387:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548395:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548412:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.548423:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.548429:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548436:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.548440:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548448:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548489:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548498:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcd3a0f8/0x1d0ed3605e13724b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.548519:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.548527:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.548530:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842098.555758:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787842098.555773:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556492:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787842098.556499:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842098.556508:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556524:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556535:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556543:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556566:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.556582:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.556588:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556596:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.556600:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556623:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556642:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556650:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686dc396/0x1d0ed3605e137252 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.556671:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.556673:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.556675:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787842098.558723:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787842098.559827:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787842098.559839:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842098.559944:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787842098.559949:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842098.559955:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842098.559985:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842098.559995:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842098.560003:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842098.560025:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.560499:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.560509:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.560520:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.560524:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.560534:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.560554:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.560574:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000634d08c0/0x1d0ed3605e137259 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.560596:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.560598:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.560600:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787842098.563828:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787842098.563844:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842098.563862:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787842098.563867:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842098.563873:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842098.563889:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842098.563899:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842098.563907:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842098.564886:0:15053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787842098.565199:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787842098.565208:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.565221:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842098.565226:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.565236:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.565254:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.565262:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc5b502/0x1d0ed3605e137260 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842098.565284:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.565286:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842098.565287:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787842098.568866:0:15053:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787842098.569239:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14393:x1874687877555456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 148569us (148694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842098.569254:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787842098.569616:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1874687877555456:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787842098.569638:0:14393:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787842098.569697:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1874687877555584:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787842098.569769:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842098.569829:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648922ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787842098.569887:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555584 00000100:00100000:2.0:1787842098.569895:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555584 00000100:00100000:2.0:1787842098.569943:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787842098.569953:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14393:x1874687877555584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787842098.570000:0:15054:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787842098.581536:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14393:x1874687877555584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11575us (11769us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787842098.581553:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787842098.581576:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1874687877555584:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787842098.581597:0:14393:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1787842098.737958:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842099.761867:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842100.786491:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787842101.011310:0:16129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg246-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787842101.811633:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842102.833916:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842103.027305:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877555712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787842103.028063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842103.031598:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555712 00000100:00100000:1.0:1787842103.031614:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555712 00000100:00100000:1.0:1787842103.031680:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787842103.031689:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877555712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787842103.031727:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787842103.031853:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874687877555712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842103.032292:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787842103.032317:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787842103.033598:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1874687877555712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787842103.317020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.317068:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858681728 00000100:00100000:3.0:1787842103.317080:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858681728 00000100:00100000:3.0:1787842103.317126:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:3.0:1787842103.317135:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2345:x1874687858681728:12345-192.168.202.46@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787842103.317167:0:14363:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 56d8499e-fbef-4bb1-ad4e-0afe3a072b32@192.168.202.46@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:3.0:1787842103.317199:0:14363:0:(genops.c:1385:class_connect()) connect: client 56d8499e-fbef-4bb1-ad4e-0afe3a072b32, cookie 0x1d0ed3605e137267 00000100:00080000:3.0:1787842103.317334:0:14363:0:(import.c:65:import_set_state_nolock()) ffff946381cfc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787842103.317405:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+5:2345:x1874687858681728:12345-192.168.202.46@tcp:250:mount.lustre.0 Request processed in 270us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842103.317413:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 76 00000100:00100000:2.0:1787842103.336219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.336312:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858681856 00000100:00100000:3.0:1787842103.336325:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858681856 00000100:00100000:3.0:1787842103.336384:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:3.0:1787842103.336396:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+5:13748:x1874687858681856:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787842103.336415:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842103.336435:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c47e00/0x1d0ed3605e13726e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e19 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842103.336502:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c47e00/0x1d0ed3605e13726e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e19 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842103.336514:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c47e00/0x1d0ed3605e13726e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e19 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842103.336524:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47e00, rc 0) 00000100:00100000:3.0:1787842103.336580:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+6:13748:x1874687858681856:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 187us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842103.336587:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 77 00000100:00100000:2.0:1787842103.354711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.354773:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858681984 00000100:00100000:3.0:1787842103.354784:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858681984 00000100:00100000:3.0:1787842103.354848:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 78 00000100:00100000:3.0:1787842103.354858:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+6:13748:x1874687858681984:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787842103.355155:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+6:13748:x1874687858681984:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 297us (450us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787842103.355163:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 78 00000100:00100000:0.0:1787842103.363164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.363263:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682112 00000100:00100000:2.0:1787842103.363274:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682112 00000100:00100000:2.0:1787842103.363341:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00100000:2.0:1787842103.363354:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+6:13748:x1874687858682112:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787842103.363374:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842103.363393:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dea00/0x1d0ed3605e137275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e20 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.363421:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dea00/0x1d0ed3605e137275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e20 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.363433:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dea00/0x1d0ed3605e137275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e20 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.363444:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dea00, rc 0) 00000100:00100000:2.0:1787842103.363544:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+7:13748:x1874687858682112:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 193us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.363552:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 79 00000100:00100000:0.0:1787842103.370413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.370528:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682240 00000100:00100000:3.0:1787842103.370536:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682240 00000100:00100000:3.0:1787842103.370584:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:3.0:1787842103.370593:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+7:13748:x1874687858682240:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787842103.371134:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13748:x1874687858682240:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 540us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842103.371143:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 80 00000100:00100000:0.0:1787842103.374021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.374255:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682368 00000100:00100000:3.0:1787842103.374282:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682368 00000100:00100000:3.0:1787842103.374344:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:3.0:1787842103.374421:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13748:x1874687858682368:12345-192.168.202.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787842103.375612:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13748:x1874687858682368:12345-192.168.202.46@tcp:503:mount.lustre.0 Request processed in 1187us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.375637:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 81 00000100:00100000:1.0:1787842103.379811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.380033:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682496 00000100:00100000:3.0:1787842103.380177:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682496 00000100:00100000:3.0:1787842103.380241:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00100000:3.0:1787842103.380252:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13766:x1874687858682496:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787842103.380956:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13766:x1874687858682496:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 701us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.380969:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 82 00000100:00100000:1.0:1787842103.422851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842103.422935:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682624 00000100:00100000:0.0:1787842103.422945:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682624 00000100:00100000:0.0:1787842103.423001:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 83 00000100:00100000:0.0:1787842103.423011:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13766:x1874687858682624:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787842103.423283:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13766:x1874687858682624:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 273us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.423291:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 83 00000100:00100000:0.0:1787842103.427623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.427960:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682752 00000100:00100000:2.0:1787842103.427971:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682752 00000100:00100000:2.0:1787842103.428036:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:2.0:1787842103.428046:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+8:13748:x1874687858682752:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787842103.428066:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842103.428099:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dfe00/0x1d0ed3605e13727c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e4a expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.428129:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dfe00/0x1d0ed3605e13727c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e4a expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.428140:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dfe00/0x1d0ed3605e13727c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e4a expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.428150:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfe00, rc 0) 00000100:00100000:2.0:1787842103.428220:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+9:13748:x1874687858682752:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 176us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.428228:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 84 00000100:00100000:2.0:1787842103.442166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.442254:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858682880 00000100:00100000:3.0:1787842103.442264:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858682880 00000100:00100000:3.0:1787842103.442312:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:3.0:1787842103.442321:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bf818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+9:13748:x1874687858682880:12345-192.168.202.46@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787842103.442349:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787842103.442374:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787842103.442378:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787842103.442381:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787842103.442384:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787842103.445303:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bf818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+9:13748:x1874687858682880:12345-192.168.202.46@tcp:256:mount.lustre.0 Request processed in 2970us (3135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842103.445320:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 85 00000100:00100000:0.0:1787842103.454732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.454858:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683008 00000100:00100000:2.0:1787842103.454868:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683008 00000100:00100000:2.0:1787842103.454961:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:2.0:1787842103.454972:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+9:13748:x1874687858683008:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787842103.454991:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842103.455008:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e51 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.455036:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.455049:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.455057:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de200, rc 0) 00000100:00100000:2.0:1787842103.455124:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13748:x1874687858683008:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 154us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.455132:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 86 00000100:00100000:0.0:1787842103.458804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842103.458884:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683136 00000100:00100000:3.0:1787842103.458893:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683136 00000100:00100000:3.0:1787842103.458945:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00100000:3.0:1787842103.458954:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13748:x1874687858683136:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787842103.459230:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13748:x1874687858683136:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 276us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842103.459238:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 87 00000100:00100000:1.0:1787842103.462058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.462165:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683264 00000100:00100000:2.0:1787842103.462174:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683264 00000100:00100000:2.0:1787842103.462235:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 88 00000100:00100000:2.0:1787842103.462245:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13748:x1874687858683264:12345-192.168.202.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787842103.462559:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13748:x1874687858683264:12345-192.168.202.46@tcp:503:mount.lustre.0 Request processed in 315us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.462567:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 88 00000100:00100000:2.0:1787842103.466659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842103.466762:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683392 00000100:00100000:0.0:1787842103.466773:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683392 00000100:00100000:0.0:1787842103.466856:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 89 00000100:00100000:0.0:1787842103.466867:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13771:x1874687858683392:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787842103.467132:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13771:x1874687858683392:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 266us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.467145:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 89 00000100:00100000:1.0:1787842103.470572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.482878:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683520 00000100:00100000:2.0:1787842103.482896:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683520 00000100:00100000:2.0:1787842103.482963:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 90 00000100:00100000:2.0:1787842103.482975:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13771:x1874687858683520:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787842103.483246:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13771:x1874687858683520:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 272us (12682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.483255:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 90 00000100:00100000:1.0:1787842103.504728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842103.504849:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683648 00000100:00100000:0.0:1787842103.504860:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683648 00000100:00100000:0.0:1787842103.504926:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:0.0:1787842103.504940:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1874687858683648:12345-192.168.202.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787842103.504971:0:14368:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d3b1cec3-3bee-4317-891b-62987a7c0b89@192.168.202.46@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1787842103.505015:0:14368:0:(genops.c:1385:class_connect()) connect: client d3b1cec3-3bee-4317-891b-62987a7c0b89, cookie 0x1d0ed3605e13728a 00000004:00100000:0.0:1787842103.505050:0:14368:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787842103.505056:0:14368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787842103.546712:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7235e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877555840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787842103.546795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842103.546930:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877556352:0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.546957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842103.546985:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787842103.546992:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7235680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877556224:0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.547012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842103.547039:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877556096:0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.547059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842103.547093:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787842103.547099:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5153086-f7d7-4317-94f4-d9c880bce3b9:3307:1874687877555968:0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.547123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842103.547145:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877556480:0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.547164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842103.547184:0:14369:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787842103.547192:0:14369:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787842103.547209:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555968 00000100:00100000:0.0:1787842103.547216:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555968 00000100:00100000:0.0:1787842103.547261:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787842103.547270:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3307:x1874687877555968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.547322:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3307:x1874687877555968:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.547330:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787842103.547380:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5153086-f7d7-4317-94f4-d9c880bce3b9:3307:1874687877555968:0@lo:400:kworker.0 00000100:00100000:2.0:1787842103.548863:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877555840 00000100:00100000:2.0:1787842103.548875:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877555840 00000100:00100000:2.0:1787842103.548946:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787842103.548955:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877555840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787842103.548993:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787842103.549064:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877555840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.549070:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787842103.549134:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7235e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877555840:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787842103.549199:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787842103.552917:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787842103.552942:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556352 00000100:00100000:1.0:1787842103.552951:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556352 00000100:00100000:1.0:1787842103.553011:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787842103.553016:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556224 00000100:00100000:1.0:1787842103.553019:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556224 00000100:00100000:1.0:1787842103.553032:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787842103.553036:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556480 00000100:00100000:1.0:1787842103.553038:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556480 00000100:00100000:1.0:1787842103.553051:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787842103.553062:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787842103.553070:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877556352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842103.553170:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874687877556352:12345-0@lo:400:kworker.0 Request processed in 101us (6212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842103.553177:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787842103.553191:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787842103.553197:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787842103.553202:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877556224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842103.553232:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874687877556224:12345-0@lo:400:kworker.0 Request processed in 30us (6218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842103.553238:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787842103.553247:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787842103.553252:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787842103.553257:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877556480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842103.553287:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874687877556480:12345-0@lo:400:kworker.0 Request processed in 30us (6122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842103.553306:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787842103.554876:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787842103.554929:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464a7234780 x1874687877556480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787842103.554946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1874687877556480:0@lo:400:kworker.0 00010000:00080000:1.0:1787842103.554983:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464a7235680 x1874687877556224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787842103.554993:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7235680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874687877556224:0@lo:400:kworker.0 00010000:00080000:1.0:1787842103.555004:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464a72361c0 x1874687877556352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787842119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787842103.555011:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1874687877556352:0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.559539:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556096 00000100:00100000:0.0:1787842103.559554:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556096 00000100:00100000:0.0:1787842103.559611:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787842103.559622:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877556096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842103.559748:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874687877556096:12345-0@lo:400:kworker.0 Request processed in 127us (12686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.559756:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787842103.560892:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877556096:0@lo:400:kworker.0 00000100:00080000:0.0:1787842103.592723:0:14368:0:(import.c:65:import_set_state_nolock()) ffff946381c4c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787842103.592823:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2345:x1874687858683648:12345-192.168.202.46@tcp:38:mount.lustre.0 Request processed in 87882us (88104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.592834:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:2.0:1787842103.597241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.597288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.597320:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683776 00000100:00100000:2.0:1787842103.597330:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683776 00000100:00100000:2.0:1787842103.597388:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858683904 00000100:00100000:2.0:1787842103.597392:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858683904 00000100:00100000:2.0:1787842103.597430:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:2.0:1787842103.597442:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7235e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:0:x1874687858683776:12345-192.168.202.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787842103.597504:0:14369:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787842103.597590:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7235e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:0:x1874687858683776:12345-192.168.202.46@tcp:41:mount.lustre.0 Request processed in 150us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.597598:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:2.0:1787842103.597633:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:2.0:1787842103.597642:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13748:x1874687858683904:12345-192.168.202.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787842103.597653:0:14369:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787842103.597678:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13748:x1874687858683904:12345-192.168.202.46@tcp:41:mount.lustre.0 Request processed in 38us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.597685:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00080000:2.0:1787842103.597703:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787842103.601552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.602046:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684032 00000100:00100000:2.0:1787842103.602056:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684032 00000100:00100000:2.0:1787842103.602126:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787842103.602137:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13748:x1874687858684032:12345-192.168.202.46@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787842103.602222:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13748:x1874687858684032:12345-192.168.202.46@tcp:40:mount.lustre.0 Request processed in 87us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.602246:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787842103.608697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842103.608773:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684416 00000100:00100000:1.0:1787842103.608785:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684416 00000100:00100000:1.0:1787842103.608936:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:1.0:1787842103.608947:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7234f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13748:x1874687858684416:12345-192.168.202.46@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787842103.609885:0:14371:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 865us 00000100:00100000:3.0:1787842103.611285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.611323:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684160 00000100:00100000:3.0:1787842103.611331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.611334:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684160 00000100:00100000:2.0:1787842103.611375:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684288 00000100:00100000:2.0:1787842103.611378:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684288 00000100:00100000:2.0:1787842103.611393:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:2.0:1787842103.611401:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874687858684160:12345-192.168.202.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787842103.611435:0:15054:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d3b1cec3-3bee-4317-891b-62987a7c0b89@192.168.202.46@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1787842103.611492:0:15054:0:(genops.c:1385:class_connect()) connect: client d3b1cec3-3bee-4317-891b-62987a7c0b89, cookie 0x1d0ed3605e137291 00002000:00100000:2.0:1787842103.611507:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d3b1cec3-3bee-4317-891b-62987a7c0b89/ffff946383a20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787842103.611519:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787842103.611838:0:15054:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787842103.611869:0:15054:0:(import.c:65:import_set_state_nolock()) ffff946383a22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787842103.611948:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2345:x1874687858684160:12345-192.168.202.46@tcp:8:mount.lustre.0 Request processed in 545us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.611956:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:2.0:1787842103.611976:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:2.0:1787842103.611981:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874687858684288:12345-192.168.202.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787842103.611996:0:15054:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d3b1cec3-3bee-4317-891b-62987a7c0b89@192.168.202.46@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1787842103.612011:0:15054:0:(genops.c:1385:class_connect()) connect: client d3b1cec3-3bee-4317-891b-62987a7c0b89, cookie 0x1d0ed3605e137298 00002000:00100000:2.0:1787842103.612017:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d3b1cec3-3bee-4317-891b-62987a7c0b89/ffff946383a22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787842103.612034:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787842103.612231:0:15054:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787842103.612246:0:15054:0:(import.c:65:import_set_state_nolock()) ffff946383a24800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787842103.612270:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2345:x1874687858684288:12345-192.168.202.46@tcp:8:mount.lustre.0 Request processed in 288us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.612277:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000004:00200000:1.0:1787842103.634768:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787842103.637318:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7234f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13748:x1874687858684416:12345-192.168.202.46@tcp:33:mount.lustre.0 Request processed in 28360us (28617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842103.637337:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000001:00080000:0.0:1787842103.681052:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1787842103.847839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842103.848054:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684544 00000100:00100000:2.0:1787842103.848066:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684544 00000100:00100000:2.0:1787842103.848397:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:2.0:1787842103.848411:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13792:x1874687858684544:12345-192.168.202.46@tcp:101:mkdir.0 00010000:00010000:2.0:1787842103.848434:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842103.848485:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13729f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e7b expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.848559:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1372a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.848575:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1372a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.848591:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1372a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787842103.849943:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787842103.849952:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787842103.850070:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1372a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.850111:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13729f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e7b expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.853113:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1372a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e7b expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842103.853140:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:2.0:1787842103.853144:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787842103.853149:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6df000, rc 0) 00000100:00100000:2.0:1787842103.853248:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:13792:x1874687858684544:12345-192.168.202.46@tcp:101:mkdir.0 Request processed in 4837us (5415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842103.853259:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00010000:00010000:1.0:1787842103.858335:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787842104.114290:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787842104.882055:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842105.905666:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842106.072627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.073124:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684672 00000100:00100000:3.0:1787842106.073135:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684672 00000100:00100000:3.0:1787842106.073223:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:3.0:1787842106.073234:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:13844:x1874687858684672:12345-192.168.202.46@tcp:41:lfs.0 00000004:00000024:3.0:1787842106.073277:0:16245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787842106.074524:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:13844:x1874687858684672:12345-192.168.202.46@tcp:41:lfs.0 Request processed in 1285us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842106.074534:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00080000:2.0:1787842106.074756:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787842106.080909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.081012:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684800 00000100:00100000:2.0:1787842106.081023:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684800 00000100:00100000:2.0:1787842106.081115:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:2.0:1787842106.081126:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13844:x1874687858684800:12345-192.168.202.46@tcp:13:lfs.0 00002000:00000024:2.0:1787842106.081170:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787842106.081262:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13844:x1874687858684800:12345-192.168.202.46@tcp:13:lfs.0 Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.081269:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00080000:1.0:1787842106.081345:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787842106.086909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.087019:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858684928 00000100:00100000:2.0:1787842106.087030:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858684928 00000100:00100000:2.0:1787842106.087173:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787842106.087186:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b980c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13844:x1874687858684928:12345-192.168.202.46@tcp:13:lfs.0 00002000:00000024:2.0:1787842106.087232:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787842106.087332:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b980c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:13844:x1874687858684928:12345-192.168.202.46@tcp:13:lfs.0 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.087360:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00080000:1.0:1787842106.095218:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787842106.363789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.364012:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685056 00000100:00100000:3.0:1787842106.364022:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685056 00000100:00100000:3.0:1787842106.364088:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:3.0:1787842106.364097:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+10:13875:x1874687858685056:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787842106.364115:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842106.364133:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c47200/0x1d0ed3605e1372ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97e82 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842106.364167:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c47200/0x1d0ed3605e1372ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e82 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842106.364180:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c47200/0x1d0ed3605e1372ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e82 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842106.364191:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47200, rc 0) 00000100:00100000:3.0:1787842106.364259:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13875:x1874687858685056:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 162us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842106.364278:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 92 00000100:00100000:0.0:1787842106.386427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.387198:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685184 00000100:00100000:2.0:1787842106.387208:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685184 00000100:00100000:2.0:1787842106.387284:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 93 00000100:00100000:2.0:1787842106.387295:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13875:x1874687858685184:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787842106.387778:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13875:x1874687858685184:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 481us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.387786:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 93 00000100:00100000:1.0:1787842106.400594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842106.412633:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685312 00000100:00100000:0.0:1787842106.412649:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685312 00000100:00100000:0.0:1787842106.412737:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 94 00000100:00100000:0.0:1787842106.412749:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13875:x1874687858685312:12345-192.168.202.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787842106.413182:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13875:x1874687858685312:12345-192.168.202.46@tcp:503:mount.lustre.0 Request processed in 433us (12610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.413191:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 94 00000100:00100000:0.0:1787842106.421151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.421232:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685440 00000100:00100000:3.0:1787842106.421244:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685440 00000100:00100000:3.0:1787842106.421325:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 95 00000100:00100000:3.0:1787842106.421338:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13882:x1874687858685440:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787842106.421792:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13882:x1874687858685440:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 456us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842106.421800:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 95 00000100:00100000:3.0:1787842106.458447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.458983:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685568 00000100:00100000:2.0:1787842106.458996:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685568 00000100:00100000:2.0:1787842106.459069:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00100000:2.0:1787842106.459080:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13882:x1874687858685568:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787842106.459738:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13882:x1874687858685568:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 656us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.459748:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 96 00000100:00100000:1.0:1787842106.502902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842106.503053:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685696 00000100:00100000:0.0:1787842106.503065:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685696 00000100:00100000:0.0:1787842106.503129:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:0.0:1787842106.503140:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13875:x1874687858685696:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787842106.503167:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842106.503191:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2045800/0x1d0ed3605e1372b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97eac expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.503228:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2045800/0x1d0ed3605e1372b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eac expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.503262:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2045800/0x1d0ed3605e1372b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eac expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.503272:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2045800, rc 0) 00000100:00100000:0.0:1787842106.503345:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13875:x1874687858685696:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 206us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.503353:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 97 00000100:00100000:0.0:1787842106.516623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.516739:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685824 00000100:00100000:3.0:1787842106.516753:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685824 00000100:00100000:3.0:1787842106.516815:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 98 00000100:00100000:3.0:1787842106.516827:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13875:x1874687858685824:12345-192.168.202.46@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787842106.516856:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787842106.516880:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787842106.516884:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787842106.516888:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787842106.516890:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787842106.522593:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13875:x1874687858685824:12345-192.168.202.46@tcp:256:mount.lustre.0 Request processed in 5747us (5960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.522608:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 98 00000100:00100000:1.0:1787842106.542255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.542426:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858685952 00000100:00100000:2.0:1787842106.542436:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858685952 00000100:00100000:2.0:1787842106.542520:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 99 00000100:00100000:2.0:1787842106.542530:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a731bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13875:x1874687858685952:12345-192.168.202.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787842106.542550:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842106.542569:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97eb3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842106.542835:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842106.542848:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842106.542858:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6dfa00, rc 0) 00000100:00100000:2.0:1787842106.542928:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a731bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13875:x1874687858685952:12345-192.168.202.46@tcp:101:mount.lustre.0 Request processed in 399us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.542935:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 99 00000100:00100000:0.0:1787842106.556261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.556436:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686080 00000100:00100000:2.0:1787842106.556448:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686080 00000100:00100000:2.0:1787842106.556548:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 100 00000100:00100000:2.0:1787842106.556559:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13875:x1874687858686080:12345-192.168.202.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787842106.557147:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13875:x1874687858686080:12345-192.168.202.46@tcp:501:mount.lustre.0 Request processed in 586us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.557156:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 100 00000100:00100000:3.0:1787842106.560425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842106.560560:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686208 00000100:00100000:0.0:1787842106.560574:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686208 00000100:00100000:0.0:1787842106.560650:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:0.0:1787842106.560660:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13875:x1874687858686208:12345-192.168.202.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787842106.561023:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13875:x1874687858686208:12345-192.168.202.46@tcp:503:mount.lustre.0 Request processed in 363us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.561032:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 101 00000100:00100000:1.0:1787842106.567164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.567419:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686336 00000100:00100000:2.0:1787842106.567430:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686336 00000100:00100000:2.0:1787842106.567515:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 102 00000100:00100000:2.0:1787842106.567525:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13886:x1874687858686336:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787842106.567862:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13886:x1874687858686336:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 338us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.567870:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 102 00000100:00100000:1.0:1787842106.575573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842106.575854:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686464 00000100:00100000:2.0:1787842106.575878:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686464 00000100:00100000:2.0:1787842106.575941:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 103 00000100:00100000:2.0:1787842106.575952:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13886:x1874687858686464:12345-192.168.202.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787842106.576224:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13886:x1874687858686464:12345-192.168.202.46@tcp:502:llog_process_th.0 Request processed in 273us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.576233:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 103 00000100:00100000:3.0:1787842106.587543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842106.592737:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686592 00000100:00100000:1.0:1787842106.592761:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686592 00000100:00100000:2.0:1787842106.595250:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:2.0:1787842106.595262:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1874687858686592:12345-192.168.202.46@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787842106.595301:0:14368:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from eea7232b-897d-4d0d-a388-928bbad7f439@192.168.202.46@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1787842106.595355:0:14368:0:(genops.c:1385:class_connect()) connect: client eea7232b-897d-4d0d-a388-928bbad7f439, cookie 0x1d0ed3605e1372c2 00000004:00100000:2.0:1787842106.595388:0:14368:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787842106.595558:0:14368:0:(import.c:65:import_set_state_nolock()) ffff946383a26800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787842106.595647:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2345:x1874687858686592:12345-192.168.202.46@tcp:38:mount.lustre.0 Request processed in 383us (8116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.595655:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:1.0:1787842106.605143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842106.605199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.605297:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686720 00000100:00100000:3.0:1787842106.605308:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686720 00000100:00100000:3.0:1787842106.605394:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686848 00000100:00100000:3.0:1787842106.605398:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686848 00000100:00100000:3.0:1787842106.605425:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:3.0:1787842106.605435:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+7:0:x1874687858686720:12345-192.168.202.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787842106.605514:0:16245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787842106.605595:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+7:0:x1874687858686720:12345-192.168.202.46@tcp:41:mount.lustre.0 Request processed in 161us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842106.605603:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:3.0:1787842106.605621:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:3.0:1787842106.605627:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+6:13875:x1874687858686848:12345-192.168.202.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787842106.605639:0:16245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787842106.605662:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+6:13875:x1874687858686848:12345-192.168.202.46@tcp:41:mount.lustre.0 Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842106.605668:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00080000:1.0:1787842106.606203:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787842106.608580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.611845:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858686976 00000100:00100000:3.0:1787842106.611862:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858686976 00000100:00100000:3.0:1787842106.611947:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:3.0:1787842106.611959:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+6:13875:x1874687858686976:12345-192.168.202.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787842106.612067:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+6:13875:x1874687858686976:12345-192.168.202.46@tcp:40:mount.lustre.0 Request processed in 110us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842106.612075:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:3.0:1787842106.624936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.624985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.625020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.625057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.625076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.625091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.625106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842106.625126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842106.625247:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687360 00000100:00100000:0.0:1787842106.625258:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687360 00000100:00100000:0.0:1787842106.625314:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:0.0:1787842106.625337:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea7232b-897d-4d0d-a388-928bbad7f439+6:13875:x1874687858687360:12345-192.168.202.46@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787842106.625639:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787842106.625813:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea7232b-897d-4d0d-a388-928bbad7f439+6:13875:x1874687858687360:12345-192.168.202.46@tcp:33:mount.lustre.0 Request processed in 477us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.625822:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:0.0:1787842106.625851:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687744 00000100:00100000:0.0:1787842106.625862:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687744 00000100:00100000:0.0:1787842106.625884:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687872 00000100:00100000:0.0:1787842106.625887:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687872 00000100:00100000:0.0:1787842106.625896:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687104 00000100:00100000:0.0:1787842106.625898:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687104 00000100:00100000:0.0:1787842106.625905:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687232 00000100:00100000:0.0:1787842106.625907:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687232 00000100:00100000:0.0:1787842106.625916:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:0.0:1787842106.625922:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858687744:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842106.625951:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858687744:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 29us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.625957:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:0.0:1787842106.625966:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787842106.625971:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858687872:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842106.625990:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858687872:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 19us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.625997:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787842106.626006:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:0.0:1787842106.626010:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874687858687104:12345-192.168.202.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787842106.626032:0:15053:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from eea7232b-897d-4d0d-a388-928bbad7f439@192.168.202.46@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1787842106.626058:0:15053:0:(genops.c:1385:class_connect()) connect: client eea7232b-897d-4d0d-a388-928bbad7f439, cookie 0x1d0ed3605e1372c9 00002000:00100000:0.0:1787842106.626070:0:15053:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eea7232b-897d-4d0d-a388-928bbad7f439/ffff946381c49800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787842106.626083:0:15053:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787842106.626173:0:15053:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787842106.626199:0:15053:0:(import.c:65:import_set_state_nolock()) ffff946381c4c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787842106.626223:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2345:x1874687858687104:12345-192.168.202.46@tcp:8:mount.lustre.0 Request processed in 212us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.626236:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:0.0:1787842106.626249:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787842106.626253:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1874687858687232:12345-192.168.202.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787842106.626265:0:15053:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from eea7232b-897d-4d0d-a388-928bbad7f439@192.168.202.46@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1787842106.626282:0:15053:0:(genops.c:1385:class_connect()) connect: client eea7232b-897d-4d0d-a388-928bbad7f439, cookie 0x1d0ed3605e1372d0 00002000:00100000:0.0:1787842106.626288:0:15053:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eea7232b-897d-4d0d-a388-928bbad7f439/ffff946489204000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787842106.626294:0:15053:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787842106.626350:0:15053:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787842106.626365:0:15053:0:(import.c:65:import_set_state_nolock()) ffff94649178a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787842106.626388:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2345:x1874687858687232:12345-192.168.202.46@tcp:8:mount.lustre.0 Request processed in 133us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.626395:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787842106.626415:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688000 00000100:00100000:0.0:1787842106.626419:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688000 00000100:00100000:0.0:1787842106.626444:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687616 00000100:00100000:0.0:1787842106.626447:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687616 00000100:00100000:0.0:1787842106.626489:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:0.0:1787842106.626495:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2348:x1874687858688000:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842106.626518:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2348:x1874687858688000:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 24us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.626525:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:0.0:1787842106.626535:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:0.0:1787842106.626541:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2348:x1874687858687616:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842106.626560:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2348:x1874687858687616:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 19us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.626572:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:2.0:1787842106.626806:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858687488 00000100:00100000:2.0:1787842106.626811:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858687488 00000100:00100000:2.0:1787842106.626857:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 104 00000100:00100000:2.0:1787842106.626864:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2348:x1874687858687488:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787842106.626890:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2348:x1874687858687488:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842106.626896:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 104 00000100:00100000:1.0:1787842106.802992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842106.803170:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688128 00000100:00100000:0.0:1787842106.803180:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688128 00000100:00100000:0.0:1787842106.803250:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:0.0:1787842106.803261:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:13907:x1874687858688128:12345-192.168.202.46@tcp:101:mkdir.0 00010000:00010000:0.0:1787842106.803296:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842106.803319:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045600/0x1d0ed3605e1372d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97edd expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.803391:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.803418:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.803434:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787842106.803677:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787842106.803682:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787842106.803778:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.803805:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045600/0x1d0ed3605e1372d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.803822:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842106.803844:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:0.0:1787842106.803847:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787842106.803851:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2045200, rc 0) 00000100:00100000:0.0:1787842106.803914:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+7:13907:x1874687858688128:12345-192.168.202.46@tcp:101:mkdir.0 Request processed in 655us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842106.803921:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00010000:00010000:1.0:1787842106.930257:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842107.953710:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842108.145704:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787842108.145729:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877556608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787842108.145797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842108.145907:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556608 00000100:00100000:0.0:1787842108.145914:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556608 00000100:00100000:0.0:1787842108.145974:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787842108.145983:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a72352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877556608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787842108.146026:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787842108.146073:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a72352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877556608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842108.146080:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787842108.146120:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877556608:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787842108.146165:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787842108.220580:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eea7232b-897d-4d0d-a388-928bbad7f439 00000001:00100000:1.0:1787842108.220598:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d3b1cec3-3bee-4317-891b-62987a7c0b89 00000100:00100000:2.0:1787842108.658622:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7237c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877556864:0@lo:400:kworker.0 00000100:00100000:2.0:1787842108.658710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842108.658777:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638291ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877557376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787842108.658895:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556864 00000100:00100000:1.0:1787842108.658904:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556864 00000100:00100000:1.0:1787842108.658979:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787842108.658990:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7235680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877556864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842108.659064:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7235680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877556864:12345-0@lo:400:kworker.0 Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842108.659072:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787842108.659231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842108.659282:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787842108.659302:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7237c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877556864:0@lo:400:kworker.0 00000100:00100000:2.0:1787842108.659317:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787842108.659324:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877556736:0@lo:400:kworker.0 00000100:00100000:2.0:1787842108.659353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842108.659375:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877557248:0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.659617:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556736 00000100:00100000:3.0:1787842108.659622:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556736 00000100:00100000:3.0:1787842108.659787:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787842108.659797:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3309:x1874687877556736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.659848:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3309:x1874687877556736:12345-0@lo:400:kworker.0 Request processed in 54us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842108.659895:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787842108.661617:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787842108.661647:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877557120:0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.661724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842108.661763:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787842108.661771:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877556992:0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.661795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842108.661827:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877557120 00000100:00100000:3.0:1787842108.661834:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877557120 00000100:00100000:3.0:1787842108.661885:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877556992 00000100:00100000:3.0:1787842108.661889:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877556992 00000100:00100000:3.0:1787842108.661911:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787842108.661920:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877557120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.661977:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874687877557120:12345-0@lo:400:kworker.0 Request processed in 58us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842108.661985:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787842108.662001:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787842108.662006:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877556992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.662034:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874687877556992:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842108.662040:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787842108.662067:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787842108.662094:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874687877556992:0@lo:400:kworker.0 00000100:00100000:3.0:1787842108.662106:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1874687877557120:0@lo:400:kworker.0 00000100:00100000:2.0:1787842108.663044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842108.663096:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5153086-f7d7-4317-94f4-d9c880bce3b9:3309:1874687877556736:0@lo:400:kworker.0 00000100:00100000:0.0:1787842108.663587:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877557248 00000100:00100000:0.0:1787842108.663593:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877557248 00000100:00100000:0.0:1787842108.663641:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787842108.663649:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7237c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877557248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842108.663708:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7237c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874687877557248:12345-0@lo:400:kworker.0 Request processed in 60us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842108.663714:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787842108.663736:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787842108.663770:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1874687877557248:0@lo:400:kworker.0 00000100:00100000:1.0:1787842108.664674:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877557376 00000100:00100000:1.0:1787842108.664681:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877557376 00000100:00100000:1.0:1787842108.664732:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787842108.664740:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7234780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877557376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787842108.664770:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787842108.664830:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7234780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877557376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (5598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842108.664845:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787842108.669385:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638291ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877557376:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787842108.724018:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d3b1cec3-3bee-4317-891b-62987a7c0b89 00000001:00100000:0.0:1787842108.724037:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eea7232b-897d-4d0d-a388-928bbad7f439 00000001:00100000:0.0:1787842108.737093:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eea7232b-897d-4d0d-a388-928bbad7f439 00000001:00100000:0.0:1787842108.737109:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d3b1cec3-3bee-4317-891b-62987a7c0b89 00010000:00010000:1.0:1787842108.978532:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787842109.806124:0:16339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787842110.006978:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787842111.030377:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842111.761769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761843:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842111.761946:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688512 00000100:00100000:1.0:1787842111.761955:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688512 00000100:00100000:1.0:1787842111.762008:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688640 00000100:00100000:1.0:1787842111.762012:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688640 00000100:00100000:1.0:1787842111.762024:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688896 00000100:00100000:1.0:1787842111.762027:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688896 00000100:00100000:1.0:1787842111.762037:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689024 00000100:00100000:1.0:1787842111.762039:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689024 00000100:00100000:1.0:1787842111.762053:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:1.0:1787842111.762063:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2349:x1874687858688512:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842111.762143:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2349:x1874687858688512:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842111.762151:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:1.0:1787842111.762167:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:1.0:1787842111.762173:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858688640:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842111.762197:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858688640:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842111.762218:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:1.0:1787842111.762231:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:1.0:1787842111.762237:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858688896:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842111.762262:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858688896:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842111.762269:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:1.0:1787842111.762280:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:1.0:1787842111.762286:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2349:x1874687858689024:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842111.762308:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2349:x1874687858689024:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842111.762314:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:1.0:1787842111.762335:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688384 00000100:00100000:1.0:1787842111.762338:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688384 00000100:00100000:1.0:1787842111.762364:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688768 00000100:00100000:1.0:1787842111.762368:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688768 00000100:00100000:1.0:1787842111.762386:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:1.0:1787842111.762392:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858688384:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842111.762419:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858688384:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842111.762426:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:1.0:1787842111.762437:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:1.0:1787842111.762443:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2349:x1874687858688768:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842111.762491:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2349:x1874687858688768:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 47us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842111.762505:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00080000:1.0:1787842111.762524:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787842111.762529:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787842111.762531:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787842111.762736:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858688256 00000100:00100000:3.0:1787842111.762741:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858688256 00000100:00100000:3.0:1787842111.762779:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 106 00000100:00100000:3.0:1787842111.762786:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2349:x1874687858688256:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787842111.762816:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2349:x1874687858688256:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842111.762822:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 106 00010000:00010000:2.0:1787842112.051643:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842113.074851:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842113.271409:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787842113.271445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877557504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787842113.271557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842113.271912:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877557504 00000100:00100000:1.0:1787842113.271922:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877557504 00000100:00100000:1.0:1787842113.272000:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787842113.273123:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877557504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787842113.273161:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787842113.273246:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877557504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842113.273266:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787842113.273293:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787842113.273336:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877557504:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1787842113.438152:0:16487:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2c7478b0 20000000:00000080:2.0:1787842113.438172:0:16487:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946383123c00 uarg=0000000000000000 20000000:01000000:2.0:1787842113.438207:0:16487:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787842113.438214:0:16487:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787842113.438219:0:16487:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787842113.440278:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787842113.440935:0:16487:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787842113.461399:0:16487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787842113.463975:0:16487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464014:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464023:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464048:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464060:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464067:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464074:0:16487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464120:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.464136:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 12 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.464152:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877557632:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787842113.465107:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465120:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.465131:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a7234b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877557760:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787842113.465199:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465224:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 18 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.465234:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877557888:0@lo:104: 00000100:00100000:2.0:1787842113.465288:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787842113.465322:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465330:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 18 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.465338:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877558016:0@lo:104: 00000100:00100000:2.0:1787842113.465360:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842113.465408:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877557888 00000100:00100000:2.0:1787842113.465415:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877557888 00000100:00100000:2.0:1787842113.465629:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558016 00000100:00100000:2.0:1787842113.465633:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558016 00000100:00100000:2.0:1787842113.465662:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787842113.465671:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638291e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+4:16487:x1874687877557888:12345-0@lo:104: 00010000:00010000:2.0:1787842113.465687:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465741:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787842113.465747:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638291e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+4:16487:x1874687877557888:12345-0@lo:104: Request processed in 77us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842113.465755:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787842113.465774:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787842113.465781:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:16487:x1874687877558016:12345-0@lo:104: 00010000:00010000:2.0:1787842113.465867:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465907:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787842113.465912:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:16487:x1874687877558016:12345-0@lo:104: Request processed in 133us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842113.465920:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787842113.465939:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787842113.465944:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465951:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480a00 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842113.465956:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.465964:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842113.465971:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842113.465976:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787842113.466006:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466013:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787842113.466031:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466037:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485480a00/0x1d0ed3605e137156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e13715d expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466059:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842113.466062:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466067:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481400 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:2.0:1787842113.466071:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466077:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787842113.466082:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787842113.466087:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787842113.466100:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466106:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787842113.466121:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466127:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff946485481400/0x1d0ed3605e137022 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e137029 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466137:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842113.466139:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842113.466140:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842113.466160:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463823530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5153086-f7d7-4317-94f4-d9c880bce3b9:3307:1874687877558144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787842113.466198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787842113.466672:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.466685:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 18 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.466695:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877558400:0@lo:104: 00000100:00100000:2.0:1787842113.466727:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842113.466762:0:16487:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648a66b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787842113.466784:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72343c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877557888:0@lo:104: 00000100:00100000:3.0:1787842113.467090:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787842113.467102:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558400 00000100:00100000:3.0:1787842113.467106:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558400 00000100:00100000:3.0:1787842113.467142:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787842113.467150:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464854e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:16487:x1874687877558400:12345-0@lo:104: 00010000:00010000:3.0:1787842113.467161:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842113.467208:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787842113.467214:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464854e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5153086-f7d7-4317-94f4-d9c880bce3b9+3:16487:x1874687877558400:12345-0@lo:104: Request processed in 66us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842113.467220:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787842113.467381:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787842113.467387:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842113.467405:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6de000 already unused, calling callback (ffffffffc1a79c20) 10000000:00010000:3.0:1787842113.467410:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842113.467418:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787842113.467752:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787842113.467761:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787842113.467861:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842113.467868:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787842113.467879:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842113.467886:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.146@tcp lock: ffff94648a6de000/0x1d0ed3605e136fd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1d0ed3605e136fdc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842113.467905:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842113.467907:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787842113.467908:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787842113.468033:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842113.468049:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382350b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877558272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787842113.468093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842113.468121:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787842113.468126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382008b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877558528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787842113.468148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842113.468179:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558144 00000100:00100000:0.0:1787842113.468185:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558144 00010000:00010000:0.0:1787842113.468212:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 19 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842113.468230:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558272 00000100:00100000:0.0:1787842113.468233:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558272 00010000:00010000:0.0:1787842113.468245:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 20 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842113.468264:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558528 00000100:00100000:0.0:1787842113.468267:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558528 00010000:00010000:0.0:1787842113.468293:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 21 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842113.468308:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787842113.468316:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+21:3307:x1874687877558144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842113.468327:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842113.468332:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 21 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468341:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 21 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468355:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485480800/0x1d0ed3605e13715d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e137156 expref: 21 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468383:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787842113.468420:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+20:3307:x1874687877558144:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.468438:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787842113.468479:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787842113.468486:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3308:x1874687877558272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842113.468495:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842113.468499:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 19 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468508:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 19 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468518:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787842113.468552:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3308:x1874687877558272:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.468558:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787842113.468571:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842113.468578:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a68c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:3308:x1874687877558528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787842113.468585:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842113.468590:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 18 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468598:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 18 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.468608:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787842113.468632:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a68c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:3308:x1874687877558528:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.468648:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787842113.468710:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463823530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5153086-f7d7-4317-94f4-d9c880bce3b9:3307:1874687877558144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787842113.468740:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382008b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877558528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787842113.468747:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382350b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5153086-f7d7-4317-94f4-d9c880bce3b9:3308:1874687877558272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787842113.469096:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946383c47c00/0x1d0ed3605e137029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e137022 expref: 17 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.469107:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464b980ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877558016:0@lo:104: 00010000:00010000:2.0:1787842113.469117:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946485481000/0x1d0ed3605e136fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1d0ed3605e136fd5 expref: 16 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842113.469124:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877558400:0@lo:104: 00000100:00100000:2.0:1787842113.470212:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a72361c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877557632:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787842113.475293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842113.475497:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689152 00000100:00100000:0.0:1787842113.475506:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689152 00010000:00010000:0.0:1787842113.475547:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 13 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842113.475582:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:0.0:1787842113.475591:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2349:x1874687858689152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787842113.475606:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842113.475627:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 13 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.475649:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 13 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.475670:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6dfa00/0x1d0ed3605e1372bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eb3 expref: 13 pid: 14360 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842113.475687:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787842113.475743:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:2349:x1874687858689152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 152us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.475751:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:2.0:1787842113.476215:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464a7234b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1874687877557760:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787842113.476255:0:16487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842113.476447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842113.476533:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689280 00000100:00100000:1.0:1787842113.476538:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689280 00010000:00010000:1.0:1787842113.476560:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842113.476590:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:1.0:1787842113.476598:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:2348:x1874687858689280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787842113.476607:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842113.476612:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476621:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476653:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94648a6de200/0x1d0ed3605e137283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e51 expref: 12 pid: 14362 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476666:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476674:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476688:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476696:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476704:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476711:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476717:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:1.0:1787842113.476721:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476729:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476744:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842113.476765:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842113.476815:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649197e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:2348:x1874687858689280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 217us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842113.476823:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00010000:00010000:2.0:1787842113.477042:0:16487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.477050:0:16487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842113.477064:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030200/0x1d0ed3605e1372e5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842113.777928:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877558656:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842113.778091:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787842113.778098:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877558784:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842113.778164:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877558912:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842113.778207:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787842113.778213:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877559040:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842113.778272:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558656 00000100:00100000:0.0:1787842113.778280:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558656 00000100:00100000:0.0:1787842113.778341:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787842113.778352:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877558656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778427:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874687877558656:12345-0@lo:400:kworker.0 Request processed in 76us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.778435:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787842113.778484:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558784 00000100:00100000:0.0:1787842113.778489:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558784 00000100:00100000:0.0:1787842113.778515:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877558912 00000100:00100000:0.0:1787842113.778518:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877558912 00000100:00100000:0.0:1787842113.778532:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559040 00000100:00100000:0.0:1787842113.778534:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559040 00000100:00100000:0.0:1787842113.778547:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787842113.778553:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877558784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778585:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877558784:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.778592:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787842113.778604:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787842113.778611:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877558912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778657:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877558912:12345-0@lo:400:kworker.0 Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.778663:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787842113.778674:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787842113.778679:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877559040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778707:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877559040:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842113.778713:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787842113.778737:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787842113.778742:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787842113.778775:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877559040:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778794:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877558912:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778819:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877558784:0@lo:400:kworker.0 00000100:00100000:0.0:1787842113.778828:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9464884c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1874687877558656:0@lo:400:kworker.0 00000100:00100000:2.0:1787842113.779021:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787842113.779032:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877559168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787842113.779063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842113.779095:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559168 00000100:00100000:2.0:1787842113.779099:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559168 00000100:00100000:2.0:1787842113.779131:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787842113.779137:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877559168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787842113.779172:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787842113.779207:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877559168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842113.779213:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787842113.779250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877559168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787842114.100795:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787842114.354158:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787842115.125776:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787842115.314977:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787842115.314984:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464b7fc7800 from 10 10000000:01000000:3.0:1787842115.314988:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787842115.315029:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.315049:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.315059:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842115.315079:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.315147:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842115.315191:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.315215:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559296 00000100:00100000:3.0:1787842115.315222:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559296 00000100:00100000:3.0:1787842115.315264:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787842115.315271:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+16:14366:x1874687877559296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842115.315282:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842115.315292:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c46600/0x1d0ed3605e1372f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e1372ec expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.315312:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c46600/0x1d0ed3605e1372f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e1372ec expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.315320:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c46600/0x1d0ed3605e1372f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e1372ec expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.315327:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46600, rc 0) 00000100:00100000:3.0:1787842115.319234:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:14366:x1874687877559296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3954us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.319247:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787842115.319341:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842115.319378:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e1372f3 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.319390:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e1372f3 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842115.319478:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.319530:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842115.319564:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.319584:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559424 00000100:00100000:3.0:1787842115.319589:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559424 00000100:00100000:3.0:1787842115.319634:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787842115.319643:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:14366:x1874687877559424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.319908:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:14366:x1874687877559424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.319915:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787842115.319946:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.319974:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.320011:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842115.320025:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.320038:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559552 00000100:00100000:3.0:1787842115.320041:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559552 00000100:00100000:3.0:1787842115.320061:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787842115.320067:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:14366:x1874687877559552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.320206:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:14366:x1874687877559552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.320218:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787842115.320254:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787842115.320944:0:16560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787842115.321002:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787842115.321019:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787842115.321028:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e1372f3 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321038:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946383c46400/0x1d0ed3605e1372ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e1372f3 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787842115.321049:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787842115.321051:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946383a60800 from 10 10000000:01000000:3.0:1787842115.321054:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787842115.321080:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321088:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321097:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842115.321113:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.321147:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842115.321174:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.321188:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559680 00000100:00100000:3.0:1787842115.321192:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559680 00000100:00100000:3.0:1787842115.321230:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787842115.321237:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+17:14366:x1874687877559680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842115.321247:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842115.321259:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c46000/0x1d0ed3605e137301 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e1372fa expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321281:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c46000/0x1d0ed3605e137301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e1372fa expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321291:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c46000/0x1d0ed3605e137301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e1372fa expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321302:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46000, rc 0) 00000100:00100000:3.0:1787842115.321332:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877559680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.321339:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787842115.321374:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842115.321386:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137301 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.321394:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e137301 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842115.321435:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.321486:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842115.321504:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab5a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.321516:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559808 00000100:00100000:3.0:1787842115.321519:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559808 00000100:00100000:3.0:1787842115.321547:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787842115.321554:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877559808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.326810:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877559808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5247us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.326824:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787842115.327015:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382009e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.327069:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.327561:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842115.327601:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.327653:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877559936 00000100:00100000:3.0:1787842115.327660:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877559936 00000100:00100000:3.0:1787842115.327704:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787842115.327713:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877559936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.327878:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877559936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.327885:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787842115.328016:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877559936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787842115.335524:0:16561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787842115.336744:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787842115.336779:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787842115.336790:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137301 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842115.336802:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff946383c47400/0x1d0ed3605e1372fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e137301 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787842115.336812:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787842115.336815:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9464bfa16800 from 10 10000000:01000000:0.0:1787842115.336818:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787842115.336859:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842115.336867:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842115.336878:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842115.336904:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877560064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787842115.336976:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842115.337356:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff94648385b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.339752:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877560064 00000100:00100000:3.0:1787842115.339767:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877560064 00000100:00100000:3.0:1787842115.339846:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787842115.339858:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+18:14366:x1874687877560064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787842115.339880:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842115.339899:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946383c46800/0x1d0ed3605e13730f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d0ed3605e137308 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.339926:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946383c46800/0x1d0ed3605e13730f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1d0ed3605e137308 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.339938:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946383c46800/0x1d0ed3605e13730f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1d0ed3605e137308 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842115.339948:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c46800, rc 0) 00000100:00100000:3.0:1787842115.340037:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877560064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.340060:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787842115.342554:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877560064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787842115.342587:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13730f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842115.342651:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1d0ed3605e13730f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842115.342741:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877560192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.342803:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842115.342850:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787842115.342944:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877560192 00000100:00100000:3.0:1787842115.342950:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877560192 00000100:00100000:3.0:1787842115.343001:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787842115.343011:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877560192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.343269:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877560192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.343277:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787842115.343367:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877560192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.343397:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877560320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.343435:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842115.343486:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787842115.343499:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877560320 00000100:00100000:2.0:1787842115.343503:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877560320 00000100:00100000:2.0:1787842115.343524:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787842115.343530:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877560320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.343688:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:14366:x1874687877560320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842115.343695:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787842115.343730:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5153086-f7d7-4317-94f4-d9c880bce3b9:14366:1874687877560320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787842115.344401:0:16562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787842115.344478:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787842115.344494:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787842115.344503:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13730f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842115.344514:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.146@tcp lock: ffff9464c2045600/0x1d0ed3605e137308 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1d0ed3605e13730f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842115.409487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842115.410313:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689408 00000100:00100000:2.0:1787842115.410323:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689408 00000100:00100000:2.0:1787842115.410373:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:2.0:1787842115.410380:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+11:13762:x1874687858689408:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787842115.410395:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842115.410411:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480030800/0x1d0ed3605e137316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ee4 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842115.410436:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030800/0x1d0ed3605e137316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ee4 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842115.410445:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480030800/0x1d0ed3605e137316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ee4 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842115.410451:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030800, rc 0) 00000100:00100000:2.0:1787842115.410515:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13762:x1874687858689408:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 136us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842115.410519:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 116 00000100:00100000:3.0:1787842115.413155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842115.413886:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689536 00000100:00100000:0.0:1787842115.413897:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689536 00000100:00100000:0.0:1787842115.413940:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:0.0:1787842115.413948:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946487041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13762:x1874687858689536:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787842115.414950:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946487041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13762:x1874687858689536:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 997us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842115.414961:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 117 00000100:00100000:3.0:1787842115.419991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842115.420054:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689664 00000100:00100000:2.0:1787842115.420064:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689664 00000100:00100000:2.0:1787842115.420125:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 118 00000100:00100000:2.0:1787842115.420135:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13762:x1874687858689664:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787842115.420382:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13762:x1874687858689664:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 248us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842115.420391:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 118 00000100:00100000:2.0:1787842115.432583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842115.433430:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689792 00000100:00100000:0.0:1787842115.433443:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689792 00000100:00100000:0.0:1787842115.433512:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 119 00000100:00100000:0.0:1787842115.433520:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+12:13762:x1874687858689792:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787842115.433538:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842115.433566:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2044200/0x1d0ed3605e13731d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3730c03197d97eeb expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842115.433593:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2044200/0x1d0ed3605e13731d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eeb expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842115.433604:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2044200/0x1d0ed3605e13731d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97eeb expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842115.433613:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044200, rc 0) 00000100:00100000:0.0:1787842115.433679:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13762:x1874687858689792:12345-192.168.202.46@tcp:101:ll_cfg_requeue.0 Request processed in 159us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842115.433692:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 119 00000100:00100000:0.0:1787842115.436550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842115.436638:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858689920 00000100:00100000:3.0:1787842115.436649:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858689920 00000100:00100000:3.0:1787842115.436711:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 120 00000100:00100000:3.0:1787842115.436722:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13762:x1874687858689920:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.437079:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13762:x1874687858689920:12345-192.168.202.46@tcp:501:ll_cfg_requeue.0 Request processed in 357us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.437087:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 120 00000100:00100000:1.0:1787842115.444217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842115.450372:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690048 00000100:00100000:3.0:1787842115.450389:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690048 00000100:00100000:3.0:1787842115.451475:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 121 00000100:00100000:3.0:1787842115.451490:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13762:x1874687858690048:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787842115.451729:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:13762:x1874687858690048:12345-192.168.202.46@tcp:503:ll_cfg_requeue.0 Request processed in 243us (7521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842115.451737:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 121 00010000:00010000:3.0:1787842116.145777:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787842116.893914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.893983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.894022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.894050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.894072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.894090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.894112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842116.894138:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690432 00000100:00100000:0.0:1787842116.894149:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690432 00000100:00100000:0.0:1787842116.894206:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690944 00000100:00100000:0.0:1787842116.894209:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690944 00000100:00100000:0.0:1787842116.894222:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690560 00000100:00100000:0.0:1787842116.894225:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690560 00000100:00100000:0.0:1787842116.894239:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690816 00000100:00100000:0.0:1787842116.894242:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690816 00000100:00100000:0.0:1787842116.894258:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787842116.894269:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858690432:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842116.894365:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858690432:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 98us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842116.894373:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787842116.894391:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:0.0:1787842116.894399:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858690944:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842116.894424:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858690944:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842116.894432:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:1.0:1787842116.894449:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:2.0:1787842116.894495:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690688 00000100:00100000:2.0:1787842116.894500:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690688 00000100:00100000:1.0:1787842116.894513:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858690560:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787842116.894538:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690304 00000100:00100000:2.0:1787842116.894543:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690304 00000100:00100000:1.0:1787842116.894551:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858690560:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 91us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842116.894771:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787842116.894781:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858690816:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842116.894809:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858690816:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842116.894825:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:2.0:1787842116.894961:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:2.0:1787842116.894971:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2348:x1874687858690688:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787842116.895002:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2348:x1874687858690688:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 33us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842116.896379:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858690176 00000100:00100000:3.0:1787842116.896392:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858690176 00000100:00100000:3.0:1787842116.896508:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:3.0:1787842116.896519:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2348:x1874687858690176:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787842116.896581:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2348:x1874687858690176:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 63us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842116.896588:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 122 00000100:00100000:0.0:1787842116.896689:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:0.0:1787842116.896703:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858690304:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1787842116.896736:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858690304:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 40us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842116.896743:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00080000:0.0:1787842116.896765:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787842116.896771:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787842116.896774:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787842116.897229:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:2.0:1787842116.898581:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 26 00010000:00010000:0.0:1787842117.171027:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787842117.284190:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.284304:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858691072 00000100:00100000:0.0:1787842117.284315:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858691072 00000100:00100000:0.0:1787842117.284388:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787842117.284400:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:14417:x1874687858691072:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787842117.284422:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842117.284445:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e137324 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ef2 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.284537:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.284552:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.284564:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.284629:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.284650:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.284658:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285320:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044600/0x1d0ed3605e137339 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285331:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044600/0x1d0ed3605e137339 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285338:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044600/0x1d0ed3605e137339 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787842117.285541:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787842117.285545:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787842117.285653:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044600/0x1d0ed3605e137339 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285666:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285672:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285678:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285684:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2044400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787842117.285687:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285701:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285713:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:0.0:1787842117.285716:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787842117.285721:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285726:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e13732b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285738:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285743:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285749:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285753:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787842117.285756:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285762:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285768:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94648391b100) 00010000:00010000:0.0:1787842117.285770:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787842117.285773:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285790:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e137332 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285964:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e137324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ef2 expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285980:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044600/0x1d0ed3605e137339 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ef2 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.285987:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94648391b500) 00010000:00010000:0.0:1787842117.285990:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787842117.285992:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044600, rc 0) 00000100:00100000:0.0:1787842117.286124:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:14417:x1874687858691072:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 1725us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842117.286132:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787842117.294239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842117.294570:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858691328 00000100:00100000:2.0:1787842117.294581:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858691328 00000100:00100000:2.0:1787842117.294651:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:2.0:1787842117.294662:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:14417:x1874687858691328:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787842117.294685:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842117.294706:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137340 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97ef9 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.294788:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.294802:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.294892:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.294951:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.294977:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.294985:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.295790:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031a00/0x1d0ed3605e137355 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.295804:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031a00/0x1d0ed3605e137355 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.295891:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031a00/0x1d0ed3605e137355 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787842117.295902:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787842117.296158:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296167:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296173:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296179:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842117.296184:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296191:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296215:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94648391b500) 00010000:00010000:2.0:1787842117.296218:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842117.296223:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296230:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137347 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296246:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296252:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296258:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296263:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842117.296266:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296271:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296278:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff946487ed3500) 00010000:00010000:2.0:1787842117.296281:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842117.296284:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.296290:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13734e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.297108:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137340 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ef9 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.297128:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031a00/0x1d0ed3605e137355 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97ef9 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.297136:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946487ed3200) 00010000:00010000:2.0:1787842117.297138:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842117.297141:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031a00, rc 0) 00000100:00100000:2.0:1787842117.297207:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14417:x1874687858691328:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 2546us (2978us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787842117.297216:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:2.0:1787842117.304220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.304360:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858691456 00000100:00100000:1.0:1787842117.304371:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858691456 00000100:00100000:1.0:1787842117.304433:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:1.0:1787842117.304445:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14417:x1874687858691456:12345-192.168.202.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787842117.304584:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14417:x1874687858691456:12345-192.168.202.46@tcp:59:lhsmtool_posix.0 Request processed in 140us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842117.304594:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:1.0:1787842117.371909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.372986:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858691584 00000100:00100000:3.0:1787842117.373000:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858691584 00000100:00100000:2.0:1787842117.373741:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:2.0:1787842117.373753:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14423:x1874687858691584:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787842117.373786:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842117.377308:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e137363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f00 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377430:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377446:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377473:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377511:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377519:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377527:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377944:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377953:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377960:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377965:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842117.377969:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377977:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.377990:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:2.0:1787842117.377993:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842117.377998:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378005:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e13736a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378028:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378033:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378038:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378043:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842117.378046:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378051:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378059:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946487ed3500) 00010000:00010000:2.0:1787842117.378061:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842117.378064:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378069:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378105:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e137363 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f00 expref: 10 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378116:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:2.0:1787842117.378118:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842117.378128:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e137363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f00 expref: 10 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.378138:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030e00, rc 0) 00000100:00100000:2.0:1787842117.378282:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14423:x1874687858691584:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4530us (6384us total) trans 0 rc 301/301 00000100:00100000:2.0:1787842117.378292:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:2.0:1787842117.399430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.399645:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858691712 00000100:00100000:1.0:1787842117.399657:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858691712 00000100:00100000:1.0:1787842117.399717:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:1.0:1787842117.399728:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14423:x1874687858691712:12345-192.168.202.46@tcp:700:lfs.0 00000100:00100000:1.0:1787842117.399821:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14423:x1874687858691712:12345-192.168.202.46@tcp:700:lfs.0 Request processed in 94us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842117.399839:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:3.0:1787842117.401611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.401702:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858691968 00000100:00100000:1.0:1787842117.401710:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858691968 00000100:00100000:1.0:1787842117.401777:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787842117.401787:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14423:x1874687858691968:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:1.0:1787842117.401840:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842117.401872:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e1372a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97e7b expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.401891:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:1.0:1787842117.401896:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787842117.402175:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.402189:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 5 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.402198:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.402248:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 5 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.402263:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 5 pid: 14368 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842117.402277:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382038780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1874687877560448:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787842117.402377:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464880b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787842117.406402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.406541:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382038780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1874687877560448:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787842117.406567:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842117.413570:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858692096 00000100:00100000:0.0:1787842117.413586:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858692096 00010000:00010000:0.0:1787842117.413646:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 6 pid: 14368 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842117.413685:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:0.0:1787842117.413695:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:2348:x1874687858692096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787842117.413709:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842117.413715:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 6 pid: 14368 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.413746:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 6 pid: 14368 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.413768:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e1372de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97edd expref: 6 pid: 14368 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.413787:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:0.0:1787842117.413793:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.413802:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.413810:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.413846:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787842117.413909:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea7232b-897d-4d0d-a388-928bbad7f439+5:2348:x1874687858692096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 215us (7518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842117.413916:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00010000:00010000:3.0:1787842117.414337:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.414346:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.414371:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.414382:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.414390:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787842117.415754:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787842117.415768:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.415778:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.415793:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.415799:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787842117.415803:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.415811:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.415823:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946487ed3900) 00010000:00010000:3.0:1787842117.415827:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787842117.415831:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.415837:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246e00/0x1d0ed3605e137378 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787842117.415857:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4070ac7 reply state 0000000089079008 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842117.415865:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787842117.415957:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382009a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+10:14423:x1874687858691968:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 14168us (14362us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787842117.415965:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00010000:00010000:0.0:1787842117.422230:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.422250:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.422259:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.422284:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946383c47c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787842117.422290:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.422299:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.422317:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9464999d2000) 00010000:00010000:0.0:1787842117.422321:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787842117.422326:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.422334:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e13737f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787842117.426137:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787842117.539175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.539286:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858692224 00000100:00100000:0.0:1787842117.539297:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858692224 00000100:00100000:0.0:1787842117.539382:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:0.0:1787842117.539393:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:14431:x1874687858692224:12345-192.168.202.46@tcp:101:lctl.0 00010000:00010000:0.0:1787842117.539419:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842117.539443:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e137386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f07 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.539541:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e13738d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.539555:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e13738d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.539590:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e13738d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787842117.539672:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787842117.539676:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787842117.539718:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e13738d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.539744:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e137386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f07 expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.539763:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044c00/0x1d0ed3605e13738d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f07 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.539772:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:0.0:1787842117.539775:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787842117.539778:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2044c00, rc 0) 00000100:00100000:0.0:1787842117.539845:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+10:14431:x1874687858692224:12345-192.168.202.46@tcp:101:lctl.0 Request processed in 453us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842117.539853:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 20 00000100:00100000:2.0:1787842117.566183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.566282:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858692352 00000100:00100000:0.0:1787842117.566293:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858692352 00000100:00100000:0.0:1787842117.566361:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:0.0:1787842117.566373:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:14432:x1874687858692352:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787842117.566394:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842117.566420:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e137394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f0e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.566530:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e13739b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.566541:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e13739b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.566550:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e13739b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787842117.566613:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787842117.566617:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787842117.566645:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e13739b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.566772:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045200/0x1d0ed3605e137394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f0e expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.566794:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045c00/0x1d0ed3605e13739b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f0e expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.566912:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:0.0:1787842117.566916:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787842117.566920:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2045c00, rc 0) 00000100:00100000:0.0:1787842117.567033:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea7232b-897d-4d0d-a388-928bbad7f439+6:14432:x1874687858692352:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 662us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842117.567041:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 21 00000100:00100000:1.0:1787842117.575728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.575900:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858692480 00000100:00100000:0.0:1787842117.575911:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858692480 00000100:00100000:0.0:1787842117.575981:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:0.0:1787842117.575991:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+6:14432:x1874687858692480:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787842117.576014:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842117.576035:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e1373a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f15 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576109:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576126:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576136:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576148:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576155:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576161:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576322:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1373b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576331:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1373b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576337:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1373b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787842117.576403:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787842117.576407:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787842117.576435:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1373b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576450:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576491:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576499:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576505:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045400 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787842117.576509:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576517:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576529:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:0.0:1787842117.576532:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787842117.576537:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576543:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045400/0x1d0ed3605e1373a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576557:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576572:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576578:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576582:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2045e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787842117.576586:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576592:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576610:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94648391b000) 00010000:00010000:0.0:1787842117.576613:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787842117.576615:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576621:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2045e00/0x1d0ed3605e1373b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576654:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2044400/0x1d0ed3605e1373a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f15 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576678:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1373b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f15 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.576686:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94648391bc00) 00010000:00010000:0.0:1787842117.576687:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787842117.576696:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481000, rc 0) 00000100:00100000:0.0:1787842117.576765:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+7:14432:x1874687858692480:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 776us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842117.576774:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 22 00000100:00100000:3.0:1787842117.580541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.580907:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858692736 00000100:00100000:1.0:1787842117.580917:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858692736 00000100:00100000:1.0:1787842117.580980:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:1.0:1787842117.580990:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea7232b-897d-4d0d-a388-928bbad7f439+7:14432:x1874687858692736:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787842117.581011:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842117.581031:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1373be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f1c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787842117.581151:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787842117.581283:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1373be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f1c expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.581297:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:1.0:1787842117.581300:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787842117.581305:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1373be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f1c expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.581317:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247800, rc 0) 00000100:00100000:1.0:1787842117.581385:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea7232b-897d-4d0d-a388-928bbad7f439+8:14432:x1874687858692736:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 396us (854us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787842117.581410:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 23 00000100:00100000:1.0:1787842117.584790:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842117.584986:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858692992 00000100:00100000:2.0:1787842117.584998:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858692992 00000100:00100000:2.0:1787842117.585063:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 24 00000100:00100000:2.0:1787842117.585073:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+8:14432:x1874687858692992:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1787842117.585133:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787842117.585161:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481000/0x1d0ed3605e1373b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f15 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.585182:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94648391bc00) 00010000:00010000:2.0:1787842117.585192:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787842117.585231:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.585245:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.585255:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787842117.585557:0:14368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000870e477b reply state 00000000bac9fa51 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842117.585566:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787842117.585579:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787842117.586816:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea7232b-897d-4d0d-a388-928bbad7f439+9:14432:x1874687858692992:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 1728us (2020us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787842117.586827:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 24 00010000:00010000:1.0:1787842117.590131:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.590149:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.590156:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.590162:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787842117.590166:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.590174:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.590191:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946487ed3500) 00010000:00010000:1.0:1787842117.590194:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787842117.590199:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.590205:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e1373cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842117.592331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.595178:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858693248 00000100:00100000:3.0:1787842117.595195:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858693248 00000100:00100000:3.0:1787842117.595269:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:3.0:1787842117.595295:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eea7232b-897d-4d0d-a388-928bbad7f439+8:14432:x1874687858693248:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787842117.595930:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eea7232b-897d-4d0d-a388-928bbad7f439+9:14432:x1874687858693248:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 635us (3607us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787842117.595938:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:2.0:1787842117.599769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.599992:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858693504 00000100:00100000:1.0:1787842117.600003:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858693504 00000100:00100000:1.0:1787842117.600107:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:1.0:1787842117.600118:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea7232b-897d-4d0d-a388-928bbad7f439+9:14432:x1874687858693504:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1787842117.600156:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842117.600176:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1373d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f23 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600264:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600280:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600292:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600304:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600311:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600317:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787842117.600491:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787842117.600605:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600614:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600620:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600636:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787842117.600640:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.600647:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601134:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:1.0:1787842117.601139:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787842117.601146:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601153:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e1373da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601169:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601175:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601181:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601185:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787842117.601188:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601194:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601213:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946488a36d00) 00010000:00010000:1.0:1787842117.601215:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787842117.601219:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601224:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247e00/0x1d0ed3605e1373e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601268:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1373d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f23 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601279:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:1.0:1787842117.601281:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787842117.601285:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e1373d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f23 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.601294:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247800, rc 0) 00000100:00100000:1.0:1787842117.601415:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea7232b-897d-4d0d-a388-928bbad7f439+10:14432:x1874687858693504:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1298us (1656us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787842117.601424:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 25 00000100:00100000:0.0:1787842117.612002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.612939:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858693632 00000100:00100000:3.0:1787842117.612951:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858693632 00000100:00100000:3.0:1787842117.613016:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:3.0:1787842117.613027:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+10:14432:x1874687858693632:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1787842117.613052:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842117.613077:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47000/0x1d0ed3605e1373ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f2a expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.613164:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.613178:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.613190:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787842117.613241:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787842117.613245:0:16245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787842117.613267:0:16245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.613294:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47000/0x1d0ed3605e1373ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 12 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.613332:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 11 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.613340:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464999d2000) 00010000:00010000:3.0:1787842117.613343:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787842117.613360:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946383c47c00, rc 0) 00000100:00100000:3.0:1787842117.613431:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea7232b-897d-4d0d-a388-928bbad7f439+11:14432:x1874687858693632:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 405us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842117.613438:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 26 00000100:00100000:2.0:1787842117.616607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.616697:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858693760 00000100:00100000:0.0:1787842117.616707:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858693760 00000100:00100000:0.0:1787842117.616769:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:0.0:1787842117.616781:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea7232b-897d-4d0d-a388-928bbad7f439+11:14432:x1874687858693760:12345-192.168.202.46@tcp:37:lfs.0 00000100:00100000:0.0:1787842117.621939:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea7232b-897d-4d0d-a388-928bbad7f439+11:14432:x1874687858693760:12345-192.168.202.46@tcp:37:lfs.0 Request processed in 5147us (5341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842117.621952:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:1.0:1787842117.628576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.628739:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858694016 00000100:00100000:3.0:1787842117.628751:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858694016 00000100:00100000:3.0:1787842117.628827:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:3.0:1787842117.628847:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485017450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eea7232b-897d-4d0d-a388-928bbad7f439+11:14432:x1874687858694016:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787842117.629089:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485017450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eea7232b-897d-4d0d-a388-928bbad7f439+12:14432:x1874687858694016:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 254us (525us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787842117.629094:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:2.0:1787842117.669841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.669943:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858694144 00000100:00100000:3.0:1787842117.669954:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858694144 00000100:00100000:3.0:1787842117.670077:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:3.0:1787842117.670090:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+10:14438:x1874687858694144:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787842117.670112:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842117.670135:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47000/0x1d0ed3605e1373fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f31 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670223:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670269:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670281:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670297:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670305:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670312:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670419:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e137412 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670427:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e137412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670435:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e137412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787842117.670495:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787842117.670499:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787842117.670548:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e137412 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670562:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670579:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670586:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670602:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6df000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787842117.670607:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670615:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670628:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:3.0:1787842117.670632:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787842117.670638:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670645:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6df000/0x1d0ed3605e137404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670657:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670663:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670668:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670673:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94648a6dfa00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787842117.670683:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670689:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670697:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9464999d2c00) 00010000:00010000:3.0:1787842117.670700:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787842117.670703:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670708:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6dfa00/0x1d0ed3605e13740b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670747:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47000/0x1d0ed3605e1373fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f31 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670760:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de200/0x1d0ed3605e137412 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f31 expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.670768:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464999d2000) 00010000:00010000:3.0:1787842117.670770:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787842117.670772:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94648a6de200, rc 0) 00000100:00100000:3.0:1787842117.670848:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+11:14438:x1874687858694144:12345-192.168.202.46@tcp:101:bash.0 Request processed in 754us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842117.670856:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 27 00000100:00100000:0.0:1787842117.689755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.689830:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858694400 00000100:00100000:3.0:1787842117.689845:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858694400 00000100:00100000:3.0:1787842117.689896:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 28 00000100:00100000:3.0:1787842117.689906:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+11:14438:x1874687858694400:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:3.0:1787842117.689942:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842117.689963:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e137419 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f38 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.690100:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.690112:0:16245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 11 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.690118:0:16245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.690662:0:16245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 11 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.690674:0:16245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 11 pid: 16245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842117.690684:0:16245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638200bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1874687877560576:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787842117.690782:0:16245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787842117.698570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.698647:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858694528 00000100:00100000:1.0:1787842117.698657:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858694528 00010000:00010000:1.0:1787842117.698701:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 12 pid: 16245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842117.698719:0:16245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638200bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1874687877560576:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787842117.698745:0:16245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842117.698752:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:1.0:1787842117.698816:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eea7232b-897d-4d0d-a388-928bbad7f439+12:2348:x1874687858694528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787842117.698914:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842117.698923:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 12 pid: 16245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.698936:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 12 pid: 16245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.699219:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946383c47c00/0x1d0ed3605e1373f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f2a expref: 12 pid: 16245 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.699242:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464999d2000) 00010000:00010000:1.0:1787842117.699405:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.699418:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.699426:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.699688:0:16245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.699697:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.699732:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.699743:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.699751:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.700641:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787842117.701435:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701451:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701484:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787842117.701496:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787842117.701524:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701532:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701538:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701543:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa18c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:3.0:1787842117.701547:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701564:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701577:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464999d2000) 00010000:00010000:3.0:1787842117.701580:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787842117.701584:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701589:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e137420 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787842117.701615:0:16245:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000169708d9 reply state 000000000799a7e7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842117.701618:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eea7232b-897d-4d0d-a388-928bbad7f439+11:2348:x1874687858694528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2799us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842117.701624:0:16245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787842117.701629:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00010000:00010000:3.0:1787842117.701658:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94648a6de000/0x1d0ed3605e137419 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 14 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701673:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 13 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842117.701681:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:3.0:1787842117.701684:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787842117.701686:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfa19e00, rc 0) 00000100:00100000:3.0:1787842117.701716:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:14438:x1874687858694400:12345-192.168.202.46@tcp:101:bash.0 Request processed in 11813us (11974us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787842117.701723:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 28 00010000:00010000:0.0:1787842117.709650:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.709670:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.709678:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.709684:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa19800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:0.0:1787842117.709690:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.709725:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.709745:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9464999d2c00) 00010000:00010000:0.0:1787842117.709748:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787842117.709754:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.709761:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19800/0x1d0ed3605e137427 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842117.725018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842117.725438:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858694656 00000100:00100000:2.0:1787842117.725450:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858694656 00000100:00100000:2.0:1787842117.725518:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:2.0:1787842117.725529:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+13:14438:x1874687858694656:12345-192.168.202.46@tcp:101:bash.0 00010000:00010000:2.0:1787842117.725558:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842117.725581:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13743c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f3f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.725802:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.725817:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.725961:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787842117.726020:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787842117.726025:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787842117.726108:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.726120:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.726146:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13743c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.726165:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.726174:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842117.726177:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787842117.726180:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030a00, rc 0) 00000100:00100000:2.0:1787842117.726248:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:14438:x1874687858694656:12345-192.168.202.46@tcp:101:bash.0 Request processed in 720us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842117.728155:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 29 00000100:00100000:2.0:1787842117.751108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.751495:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858694912 00000100:00100000:0.0:1787842117.751505:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858694912 00000100:00100000:0.0:1787842117.751565:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:0.0:1787842117.751576:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382351680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:14438:x1874687858694912:12345-192.168.202.46@tcp:35:bash.0 00000100:00100000:0.0:1787842117.752340:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382351680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+15:14438:x1874687858694912:12345-192.168.202.46@tcp:35:bash.0 Request processed in 764us (1241us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787842117.752357:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:1.0:1787842117.865039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842117.865299:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858695168 00000100:00100000:2.0:1787842117.865310:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858695168 00000100:00100000:2.0:1787842117.865373:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 30 00000100:00100000:2.0:1787842117.865384:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+15:14448:x1874687858695168:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1787842117.865412:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842117.865434:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13744a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f46 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787842117.865619:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787842117.865772:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13744a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f46 expref: 17 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.865787:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648391b100) 00010000:00010000:2.0:1787842117.865790:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787842117.865796:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13744a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f46 expref: 17 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.865811:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030e00, rc 0) 00000100:00100000:2.0:1787842117.866196:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+16:14448:x1874687858695168:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 810us (1164us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787842117.866206:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 30 00000100:00100000:1.0:1787842117.879299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.879391:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858695424 00000100:00100000:3.0:1787842117.879421:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858695424 00000100:00100000:3.0:1787842117.879530:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:3.0:1787842117.879543:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+16:14448:x1874687858695424:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787842117.880162:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+17:14448:x1874687858695424:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 620us (873us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787842117.880170:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:1.0:1787842117.934942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842117.935101:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858695680 00000100:00100000:0.0:1787842117.935112:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858695680 00000100:00100000:0.0:1787842117.935241:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:0.0:1787842117.935253:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+17:14451:x1874687858695680:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1787842117.935280:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787842117.935303:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e137458 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f4d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.935443:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e13745f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.935500:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e13745f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.935513:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e13745f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787842117.935527:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787842117.935675:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485480800/0x1d0ed3605e137458 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f4d expref: 20 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.935695:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e13745f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f4d expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842117.935705:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:0.0:1787842117.935708:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787842117.935711:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946485481600, rc 0) 00000100:00100000:0.0:1787842117.936084:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+19:14451:x1874687858695680:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 832us (1153us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787842117.936093:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:1.0:1787842117.939908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.940678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842117.940702:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858695936 00000100:00100000:1.0:1787842117.940725:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858695936 00000100:00100000:1.0:1787842117.940797:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:1.0:1787842117.940821:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+19:2346:x1874687858695936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787842117.940849:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842117.940873:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946485481600/0x1d0ed3605e13745f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f4d expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842117.940892:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842117.940898:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842117.940948:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:2346:x1874687858695936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842117.941112:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:2.0:1787842117.942569:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858695808 00000100:00100000:2.0:1787842117.942584:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858695808 00000100:00100000:2.0:1787842117.942700:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:2.0:1787842117.942722:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:14451:x1874687858695808:12345-192.168.202.46@tcp:54:lfs.0 00010000:00010000:2.0:1787842117.942798:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.942814:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.942826:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943068:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943090:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943096:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943101:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842117.943106:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943114:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943125:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842117.943129:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787842117.943135:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842117.943140:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13746d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842117.943229:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:14451:x1874687858695808:12345-192.168.202.46@tcp:54:lfs.0 Request processed in 508us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842117.943236:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:1.0:1787842117.946789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842117.946942:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858696192 00000100:00100000:3.0:1787842117.946953:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858696192 00000100:00100000:3.0:1787842117.947096:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00000100:00100000:3.0:1787842117.947107:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:14451:x1874687858696192:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1787842117.947432:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+19:14451:x1874687858696192:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 326us (721us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787842117.947441:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00010000:00010000:3.0:1787842118.195406:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787842118.320059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.321722:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858696448 00000100:00100000:1.0:1787842118.321749:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858696448 00000100:00080000:0.0:1787842118.321853:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787842118.321860:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:1.0:1787842118.321874:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+19:14482:x1874687858696448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1787842118.321901:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842118.321925:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e137474 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f54 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.322031:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e13747b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.322046:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e13747b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.322058:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e13747b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787842118.322088:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787842118.322244:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247c00/0x1d0ed3605e137474 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f54 expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.322266:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e13747b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f54 expref: 21 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.322276:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842118.322279:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787842118.322283:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7247200, rc 0) 00000100:00100000:1.0:1787842118.322356:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:14482:x1874687858696448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 486us (2308us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787842118.322363:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 33 00000100:00100000:0.0:1787842118.329574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842118.329746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.329903:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858696832 00000100:00100000:3.0:1787842118.329913:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858696832 00000100:00100000:3.0:1787842118.329989:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:3.0:1787842118.330001:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:14482:x1874687858696832:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1787842118.330357:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+22:14482:x1874687858696832:12345-192.168.202.46@tcp:35:cat.0 Request processed in 358us (610us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787842118.330377:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8 00000100:00100000:2.0:1787842118.336877:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858696576 00000100:00100000:2.0:1787842118.336894:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858696576 00000100:00100000:2.0:1787842118.337167:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787842118.337180:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+22:2348:x1874687858696576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787842118.337229:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787842118.337256:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247200/0x1d0ed3605e13747b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f54 expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.337278:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.337283:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787842118.337357:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:2348:x1874687858696576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 181us (7797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.337373:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787842118.385834:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649fd97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877560704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787842118.385918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842118.386079:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877560704 00000100:00100000:1.0:1787842118.386091:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877560704 00000100:00100000:1.0:1787842118.386166:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787842118.386176:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877560704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787842118.386213:0:15057:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787842118.386297:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787842118.386898:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874687877560704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 721us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.386906:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787842118.387650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649fd97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1874687877560704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787842118.398601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.398704:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858697088 00000100:00100000:2.0:1787842118.399023:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858697088 00000100:00100000:2.0:1787842118.399123:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:2.0:1787842118.399133:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:14488:x1874687858697088:12345-192.168.202.46@tcp:101:dd.0 00010000:00010000:2.0:1787842118.399158:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842118.399178:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e137489 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f5b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399288:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399302:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 22 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399309:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399340:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399391:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399407:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 22 pid: 14370 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.399421:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1874687877560832:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787842118.399544:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 22 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.399553:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 22 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.399562:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1874687877560960:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787842118.399583:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787842118.404045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.404103:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858697216 00000100:00100000:0.0:1787842118.404104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.404113:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858697216 00010000:00010000:1.0:1787842118.404153:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 23 pid: 14370 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.404189:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858697344 00000100:00100000:1.0:1787842118.404203:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858697344 00010000:00010000:1.0:1787842118.404218:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 24 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.404236:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:3.0:1787842118.404286:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787842118.404295:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787842118.404503:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648a68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:2348:x1874687858697216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787842118.404518:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842118.404526:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 24 pid: 14370 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.404540:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 24 pid: 14370 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.404565:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842118.404571:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.404579:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.404600:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787842118.404655:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648a68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:2348:x1874687858697216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 157us (617us total) trans 0 rc 0/0 00010000:00010000:2.0:1787842118.404776:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137443 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f3f expref: 24 pid: 14370 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.404794:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1874687877560832:192.168.202.46@tcp:104: 00000100:00100000:2.0:1787842118.404806:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382353c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1874687877560960:192.168.202.46@tcp:104: 00010000:00010000:2.0:1787842118.404827:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842118.407649:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 12 00000100:00100000:0.0:1787842118.407682:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+23:2348:x1874687858697344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787842118.407705:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787842118.407716:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 23 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842118.407732:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 23 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.407837:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00010000:00010000:0.0:1787842118.409445:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19e00/0x1d0ed3605e13742e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f38 expref: 22 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842118.409495:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:0.0:1787842118.409500:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842118.409512:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842118.409520:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842118.409551:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787842118.409578:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.409598:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842118.409636:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:2348:x1874687858697344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1969us (5529us total) trans 0 rc 0/0 00000004:00200000:1.0:1787842118.409641:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1787842118.409655:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 12 00010000:00010000:1.0:1787842118.410138:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e137489 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f5b expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.410158:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480031000/0x1d0ed3605e137490 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f5b expref: 21 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.410166:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842118.410168:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787842118.410171:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031000, rc 0) 00000100:00100000:1.0:1787842118.410221:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:14488:x1874687858697088:12345-192.168.202.46@tcp:101:dd.0 Request processed in 11090us (11645us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787842118.410228:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 34 00000100:00100000:1.0:1787842118.414737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.414888:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858697600 00000100:00100000:3.0:1787842118.414899:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858697600 00000100:00100000:3.0:1787842118.415292:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 35 00000100:00100000:3.0:1787842118.415305:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+21:14488:x1874687858697600:12345-192.168.202.46@tcp:36:dd.0 00010000:00010000:3.0:1787842118.415697:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.415720:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.415734:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787842118.415791:0:16245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787842118.415821:0:16245:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef3d9414 reply state 0000000040694715 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.415832:0:16245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787842118.415938:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382038b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14488:x1874687858697600:12345-192.168.202.46@tcp:36:dd.0 Request processed in 635us (1209us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787842118.415961:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 35 00000020:00080000:3.0:1787842118.415966:0:16245:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787842118.418268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1787842118.418449:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.418542:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.418549:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.418556:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa18c00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787842118.418561:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.418568:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.418615:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842118.418619:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787842118.418624:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.418631:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18c00/0x1d0ed3605e13749e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.418790:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858697728 00000100:00100000:2.0:1787842118.418801:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858697728 00000100:00100000:2.0:1787842118.418896:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:2.0:1787842118.418908:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+23:14488:x1874687858697728:12345-192.168.202.46@tcp:101:dd.0 00010000:00010000:2.0:1787842118.418937:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842118.418972:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f62 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.419033:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f62 expref: 24 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.419047:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f62 expref: 24 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.419065:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.419068:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787842118.419071:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030200, rc 0) 00000100:00100000:2.0:1787842118.419135:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14488:x1874687858697728:12345-192.168.202.46@tcp:101:dd.0 Request processed in 229us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.419142:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 36 00000100:00100000:2.0:1787842118.431873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.432768:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858697984 00000100:00100000:3.0:1787842118.432783:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858697984 00000100:00100000:2.0:1787842118.432910:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:2.0:1787842118.432919:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14488:x1874687858697984:12345-192.168.202.46@tcp:103:dd.0 00010000:00010000:2.0:1787842118.432934:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787842118.433062:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f62 expref: 24 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.433093:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.433098:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787842118.433152:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382353c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+23:14488:x1874687858697984:12345-192.168.202.46@tcp:103:dd.0 Request processed in 235us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.433157:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:0.0:1787842118.435129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.435190:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858698112 00000100:00100000:1.0:1787842118.435200:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858698112 00000100:00100000:1.0:1787842118.435248:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:1.0:1787842118.435257:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+23:14488:x1874687858698112:12345-192.168.202.46@tcp:58:dd.0 00010000:00010000:1.0:1787842118.435351:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.435368:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.435380:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787842118.436335:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787842118.436505:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787842118.436576:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787842118.436849:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+23:14488:x1874687858698112:12345-192.168.202.46@tcp:58:dd.0 Request processed in 1588us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.436859:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 37 00000100:00100000:0.0:1787842118.441599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.441824:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858698240 00000100:00100000:1.0:1787842118.441836:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858698240 00000100:00100000:1.0:1787842118.441925:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 38 00000100:00100000:1.0:1787842118.441938:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464884c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+23:14488:x1874687858698240:12345-192.168.202.46@tcp:101:dd.0 00010000:00010000:1.0:1787842118.442034:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842118.442057:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f69 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.442128:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.442140:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.442162:0:14370:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.442174:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.442187:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842118.442190:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787842118.442194:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.442277:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246600, rc 0) 00000100:00100000:1.0:1787842118.442382:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464884c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14488:x1874687858698240:12345-192.168.202.46@tcp:101:dd.0 Request processed in 447us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.442390:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 38 00000040:00080000:1.0:1787842118.449755:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787842118.449771:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787842118.449813:0:14402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787842118.449819:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787842118.450069:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382039680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14402:1874687877561088:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787842118.450170:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464880b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787842118.462248:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382039680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14402:1874687877561088:192.168.202.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787842118.465237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.465350:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858698368 00000100:00100000:2.0:1787842118.465360:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858698368 00000100:00100000:2.0:1787842118.465419:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:2.0:1787842118.465430:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698368:12345-192.168.202.46@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787842118.465547:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698368:12345-192.168.202.46@tcp:900:lhsmtool_posix.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.465556:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:0.0:1787842118.470283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.470421:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858698496 00000100:00100000:3.0:1787842118.470433:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858698496 00000100:00100000:3.0:1787842118.470540:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:3.0:1787842118.470553:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698496:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787842118.470607:0:16245:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787842118.470731:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698496:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.470739:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 39 00000100:00100000:3.0:1787842118.477161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.477275:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858698624 00000100:00100000:2.0:1787842118.477285:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858698624 00000100:00100000:2.0:1787842118.477382:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:2.0:1787842118.477393:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698624:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787842118.477499:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477516:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477528:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477582:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477605:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477613:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477638:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477648:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477654:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787842118.477693:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787842118.477697:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787842118.477720:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477732:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477739:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477745:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477750:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.477763:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477778:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477792:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946487ed3200) 00010000:00010000:2.0:1787842118.477796:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842118.477801:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.477807:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e1374ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478143:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478151:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478157:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478161:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.478164:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478170:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478179:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff946487ed3500) 00010000:00010000:2.0:1787842118.478182:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842118.478185:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478203:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478219:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478225:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478230:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478236:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.478239:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478246:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478254:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.478256:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842118.478259:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.478264:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.478341:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698624:12345-192.168.202.46@tcp:34:lhsmtool_posix.0 Request processed in 948us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.478349:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 40 00000100:00100000:0.0:1787842118.482787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.491840:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858698880 00000100:00100000:1.0:1787842118.491856:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858698880 00000100:00100000:1.0:1787842118.492079:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:1.0:1787842118.492092:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+24:14489:x1874687858698880:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787842118.492114:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842118.492136:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1374cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f70 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492241:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492256:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492269:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787842118.492280:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787842118.492389:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492397:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492421:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492426:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7246000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787842118.492431:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492438:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492450:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:1.0:1787842118.492453:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787842118.492476:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492484:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e1374d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492531:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1374cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f70 expref: 26 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492542:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946487ed3200) 00010000:00010000:1.0:1787842118.492544:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787842118.492547:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246200/0x1d0ed3605e1374cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f70 expref: 26 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.492557:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246200, rc 0) 00000100:00100000:1.0:1787842118.492634:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+25:14489:x1874687858698880:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 546us (9858us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787842118.492651:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 41 00000100:00100000:0.0:1787842118.497919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.498081:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858699008 00000100:00100000:1.0:1787842118.498092:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858699008 00000100:00100000:1.0:1787842118.498195:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:1.0:1787842118.498214:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+25:14489:x1874687858699008:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787842118.498251:0:14368:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787842118.498398:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+25:14489:x1874687858699008:12345-192.168.202.46@tcp:53:lhsmtool_posix.0 Request processed in 185us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.498407:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 42 00000100:00100000:3.0:1787842118.502431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.502657:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858699264 00000100:00100000:2.0:1787842118.502667:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858699264 00000100:00100000:2.0:1787842118.502738:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:2.0:1787842118.502749:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+25:14489:x1874687858699264:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787842118.502769:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842118.502790:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f77 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787842118.506078:0:16245:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1787842118.506093:0:16245:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787842118.506143:0:16245:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787842118.506513:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.506532:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.506545:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.506631:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f77 expref: 28 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.506652:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f77 expref: 27 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.506661:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946487ed3500) 00010000:00010000:2.0:1787842118.506664:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787842118.506667:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030200, rc 0) 00000100:00100000:2.0:1787842118.506761:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+27:14489:x1874687858699264:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 4013us (4340us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787842118.506771:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 43 00000100:00100000:0.0:1787842118.515252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.519215:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858699520 00000100:00100000:2.0:1787842118.519230:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858699520 00000100:00100000:2.0:1787842118.519292:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:2.0:1787842118.519302:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+27:14489:x1874687858699520:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787842118.519364:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787842118.519392:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e1374eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f77 expref: 27 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519413:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946487ed3500) 00010000:00010000:2.0:1787842118.519426:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787842118.519451:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519511:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519522:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519556:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519563:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519570:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519674:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519682:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519688:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519694:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.519698:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519838:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519846:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464999d2000) 00010000:00010000:2.0:1787842118.519849:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842118.519853:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519858:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e1374f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519867:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519873:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519878:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519889:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030a00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.519892:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519898:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519906:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x621d4591 (ffff946487ed3900) 00010000:00010000:2.0:1787842118.519908:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842118.519910:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.519916:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030a00/0x1d0ed3605e137500 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x621d4591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.520068:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+26:14489:x1874687858699520:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 765us (4824us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787842118.520076:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 44 00000100:00100000:3.0:1787842118.523387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.523553:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858699648 00000100:00100000:1.0:1787842118.523564:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858699648 00000100:00100000:1.0:1787842118.523635:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:1.0:1787842118.523646:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+26:14489:x1874687858699648:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787842118.523669:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787842118.523694:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e137507 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f7e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.523843:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13750e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.523857:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13750e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.523869:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13750e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.523983:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246000/0x1d0ed3605e137507 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f7e expref: 28 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.524010:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246a00/0x1d0ed3605e13750e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f7e expref: 27 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.524019:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:1.0:1787842118.524022:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787842118.524026:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464a7246a00, rc 0) 00000100:00100000:1.0:1787842118.524141:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+27:14489:x1874687858699648:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 497us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.524149:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 45 00000100:00100000:1.0:1787842118.528931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.529074:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858699904 00000100:00100000:2.0:1787842118.529086:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858699904 00000100:00100000:2.0:1787842118.529152:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 46 00000100:00100000:2.0:1787842118.529163:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+27:14489:x1874687858699904:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787842118.529253:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.529272:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.529285:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787842118.529792:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787842118.529804:0:14370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 507504346405ns, next at 508504343408ns, rc = 0 00000004:00010000:2.0:1787842118.529902:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a1f996f reply state 0000000060680d1a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.529912:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787842118.530224:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382039680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+29:14489:x1874687858699904:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1302us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787842118.530233:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 46 00010000:00010000:2.0:1787842118.531789:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.531801:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.531806:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.531810:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.531820:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.531826:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.531838:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:2.0:1787842118.531840:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787842118.531850:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.531878:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030200/0x1d0ed3605e137515 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.533774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.534002:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858700032 00000100:00100000:3.0:1787842118.534012:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858700032 00000100:00100000:3.0:1787842118.534079:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:3.0:1787842118.534091:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+28:14489:x1874687858700032:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787842118.534122:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842118.534149:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f85 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.534235:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 29 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.534251:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 29 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.534272:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:3.0:1787842118.534276:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787842118.534280:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfa18600, rc 0) 00000100:00100000:3.0:1787842118.534347:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+29:14489:x1874687858700032:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 258us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.534354:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 47 00000100:00100000:0.0:1787842118.538507:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.538650:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858700160 00000100:00100000:2.0:1787842118.538662:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858700160 00000100:00100000:2.0:1787842118.538740:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:2.0:1787842118.538750:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2348:x1874687858700160:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787842118.539151:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858700160:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 402us (701us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787842118.539160:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00080000:0.0:1787842118.539233:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787842118.542396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.542493:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858700416 00000100:00100000:3.0:1787842118.542503:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858700416 00000100:00100000:3.0:1787842118.542559:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:3.0:1787842118.542569:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+29:14489:x1874687858700416:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787842118.542835:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+30:14489:x1874687858700416:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 267us (447us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787842118.542855:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9 00000100:00100000:3.0:1787842118.546391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1787842118.546599:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858700672 00000100:00100000:0.0:1787842118.546611:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858700672 00000100:00100000:0.0:1787842118.546674:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:0.0:1787842118.546685:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+30:14489:x1874687858700672:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787842118.546841:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+30:14489:x1874687858700672:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 157us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787842118.546849:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 48 00000100:00100000:0.0:1787842118.551046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.551144:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858700800 00000100:00100000:3.0:1787842118.551154:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858700800 00000100:00100000:3.0:1787842118.551306:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:3.0:1787842118.551316:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+30:14489:x1874687858700800:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787842118.551338:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842118.551358:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137523 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f8c expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.551433:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18400/0x1d0ed3605e13752a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.551448:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18400/0x1d0ed3605e13752a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.551538:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18400/0x1d0ed3605e13752a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787842118.551580:0:16245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787842118.551610:0:16245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18400/0x1d0ed3605e13752a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.551638:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137523 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f8c expref: 32 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.551658:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18400/0x1d0ed3605e13752a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f8c expref: 31 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.551686:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:3.0:1787842118.551689:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787842118.551693:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfa18400, rc 0) 00000100:00100000:3.0:1787842118.551834:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+31:14489:x1874687858700800:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 518us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.551842:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 49 00000100:00100000:1.0:1787842118.556544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.556714:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858700928 00000100:00100000:2.0:1787842118.556726:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858700928 00000100:00100000:2.0:1787842118.556792:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:2.0:1787842118.556803:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638203ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+6:2348:x1874687858700928:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787842118.556831:0:15053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787842118.556852:0:15053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f93 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787842118.556883:0:15053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904e47, blocks: 0x1 00010000:00010000:2.0:1787842118.556907:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787842118.556913:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842118.556923:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 7 pid: 15053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.556943:0:15053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 7 pid: 15053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.556982:0:15053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030200, rc 0) 00000100:00100000:2.0:1787842118.557052:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638203ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2348:x1874687858700928:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 250us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.557059:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:0.0:1787842118.561058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.561226:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858701184 00000100:00100000:2.0:1787842118.561237:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858701184 00000100:00100000:2.0:1787842118.561301:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 50 00000100:00100000:2.0:1787842118.561312:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+31:14489:x1874687858701184:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787842118.561441:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+31:14489:x1874687858701184:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 131us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.561450:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 50 00000100:00100000:3.0:1787842118.564918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.565113:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858701312 00000100:00100000:1.0:1787842118.565123:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858701312 00000100:00100000:1.0:1787842118.565182:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 51 00000100:00100000:1.0:1787842118.565192:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+31:14489:x1874687858701312:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787842118.608281:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:2.0:1787842118.608313:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1787842118.608326:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1787842118.608342:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1787842118.608347:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787842118.608880:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787842118.609104:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+22:14489:x1874687858701312:12345-192.168.202.46@tcp:44:lhsmtool_posix.0 Request processed in 43910us (44194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.609112:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 51 00000001:00080000:0.0:1787842118.609256:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1787842118.609275:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787842118.614075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.614285:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858701440 00000100:00100000:1.0:1787842118.614296:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858701440 00000100:00100000:1.0:1787842118.614356:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:1.0:1787842118.614367:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2348:x1874687858701440:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787842118.614527:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2348:x1874687858701440:12345-192.168.202.46@tcp:16:lhsmtool_posix.0 Request processed in 162us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.614536:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:0.0:1787842118.617423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.617546:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858701696 00000100:00100000:1.0:1787842118.617569:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858701696 00000100:00100000:1.0:1787842118.617645:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 52 00000100:00100000:1.0:1787842118.617654:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:14489:x1874687858701696:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787842118.617710:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842118.617737:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18400/0x1d0ed3605e13752a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f8c expref: 14 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.617756:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:1.0:1787842118.617762:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787842118.617794:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.617807:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.617817:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787842118.618025:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e797491 reply state 000000007c7a239f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.618035:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787842118.618136:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+15:14489:x1874687858701696:12345-192.168.202.46@tcp:36:lhsmtool_posix.0 Request processed in 482us (725us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787842118.618144:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 52 00010000:00010000:1.0:1787842118.621324:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.621343:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.621369:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.621375:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:1.0:1787842118.621380:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.621388:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.621404:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877561216:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787842118.621404:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:1.0:1787842118.621407:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787842118.621412:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.621418:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247800/0x1d0ed3605e137538 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.621484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787842118.621679:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877561216 00000100:00100000:0.0:1787842118.621692:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877561216 00000100:00100000:0.0:1787842118.621760:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787842118.621771:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877561216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787842118.622125:0:15054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787842118.622129:0:15054:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787842118.622130:0:15054:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787842118.622132:0:15054:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787842119 -> 1787842119 00002000:00010000:0.0:1787842118.622135:0:15054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787842118.622187:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874687877561216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 417us (703us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787842118.622194:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787842118.622603:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946382352940/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787842118.622611:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877561216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787842118.625965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.626580:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858701824 00000100:00100000:3.0:1787842118.626600:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858701824 00000100:00100000:3.0:1787842118.626655:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787842118.626665:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:14489:x1874687858701824:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787842118.626685:0:15053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787842118.626927:0:15053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3730c03197d97f9a expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.627025:0:15053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 8 pid: 15053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.627035:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787842118.627039:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787842118.627046:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 8 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.627080:0:15053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 8 pid: 15053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.627108:0:15053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 8 pid: 15053 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.627124:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15053:1874687877561344:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787842118.627578:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842118.631143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.631229:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858701952 00000100:00100000:2.0:1787842118.631260:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858701952 00010000:00010000:2.0:1787842118.631307:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 9 pid: 15053 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.631352:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:2.0:1787842118.631362:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:2349:x1874687858701952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787842118.631378:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787842118.631401:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 9 pid: 15053 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.631416:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 9 pid: 15053 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.631443:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842118.631448:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842118.631475:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.631486:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.631526:0:14355:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.631541:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14355:1874687877561472:192.168.202.46@tcp:105: 00000100:00100000:2.0:1787842118.631633:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787842118.632331:0:15053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137531 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f93 expref: 9 pid: 15053 timeout: 607 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.632347:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15053:1874687877561344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1787842118.632371:0:15053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 8 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.632381:0:15053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfa18000, rc 0) 00000100:00100000:3.0:1787842118.632499:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+8:14489:x1874687858701824:12345-192.168.202.46@tcp:101:lhsmtool_posix.0 Request processed in 5834us (6554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.632508:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:0.0:1787842118.636649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.636915:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14355:1874687877561472:192.168.202.46@tcp:105: 00010000:00010000:2.0:1787842118.636940:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787842118.637069:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2349:x1874687858701952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5707us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.637080:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13 00000100:00100000:1.0:1787842118.637184:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858702080 00000100:00100000:1.0:1787842118.637191:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858702080 00000100:00100000:1.0:1787842118.637237:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:1.0:1787842118.637246:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2349:x1874687858702080:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787842118.637623:0:15054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787842118.637627:0:15054:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787842119 00002000:00010000:1.0:1787842118.637630:0:15054:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787842118 00002000:00010000:1.0:1787842118.637632:0:15054:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787842119 -> 1787842119 00002000:00010000:1.0:1787842118.637634:0:15054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787842118.637665:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+8:2349:x1874687858702080:12345-192.168.202.46@tcp:2:lhsmtool_posix.0 Request processed in 420us (1026us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787842118.637687:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:0.0:1787842118.641038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.641153:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858702208 00000100:00100000:3.0:1787842118.641163:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858702208 00000100:00100000:3.0:1787842118.641218:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:3.0:1787842118.641228:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+8:2346:x1874687858702208:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787842118.641277:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.641314:0:15053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 8 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.641323:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787842118.641328:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787842118.641333:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.641366:0:15053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 8 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.641380:0:15053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 8 pid: 15053 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.641395:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15053:1874687877561600:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787842118.641510:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787842118.645148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.645286:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858702336 00000100:00100000:1.0:1787842118.645297:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858702336 00010000:00010000:1.0:1787842118.645342:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.645392:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15053:1874687877561600:192.168.202.46@tcp:104: 00000100:00100000:1.0:1787842118.645395:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14 00000100:00100000:1.0:1787842118.645404:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:2348:x1874687858702336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787842118.645416:0:15053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.645418:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842118.645441:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.645454:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.645514:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013136410/0x1d0ed3605e13753f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f9a expref: 9 pid: 15053 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.645531:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787842118.645535:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787842118.645540:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.645548:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.645604:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787842118.645649:0:15053:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.645657:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+8:2348:x1874687858702336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 254us (519us total) trans 0 rc 0/0 00010000:00010000:3.0:1787842118.645658:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.645665:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14 00010000:00010000:3.0:1787842118.645690:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.645709:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.645717:0:15053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.645724:0:15053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa19200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787842118.645728:0:15053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.645738:0:15053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.645763:0:15053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.645771:0:15053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8630067/0x1d0ed3605e137546 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.646046:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2346:x1874687858702208:12345-192.168.202.46@tcp:1:lhsmtool_posix.0 Request processed in 4818us (5016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.646065:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:0.0:1787842118.649132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.649346:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858702592 00000100:00100000:3.0:1787842118.649358:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858702592 00000100:00100000:3.0:1787842118.649487:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 53 00000100:00100000:3.0:1787842118.649499:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:14489:x1874687858702592:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787842118.649603:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.649621:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.649634:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.650064:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.650077:0:16245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.650086:0:16245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.650122:0:16245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.650137:0:16245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 15 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.650166:0:16245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1874687877561728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1787842118.650270:0:16245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464ab45f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787842118.653213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.653513:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858702720 00000100:00100000:1.0:1787842118.653523:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858702720 00000100:00100000:3.0:1787842118.653542:0:16245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463820092c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1874687877561728:192.168.202.46@tcp:104: 00010000:00010000:1.0:1787842118.653568:0:16601:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 16 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.653570:0:16245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.653614:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15 00000100:00100000:1.0:1787842118.653625:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+16:2349:x1874687858702720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787842118.653641:0:16601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787842118.653649:0:16601:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 16 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.653661:0:16601:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 16 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.653683:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18600/0x1d0ed3605e13751c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f85 expref: 16 pid: 16245 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.653700:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:1.0:1787842118.653706:0:16601:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.653715:0:16601:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.653735:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.653762:0:16601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787842118.653788:0:16245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.653795:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787842118.653826:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+15:2349:x1874687858702720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 203us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.653834:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15 00000001:00080000:2.0:1787842118.655442:0:16245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787842118.655653:0:16245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787842118.655696:0:16245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787842118.655801:0:16245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16245:1874687877561856:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787842118.656367:0:16245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842118.656486:0:16245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787842118.656604:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877561856 00000100:00100000:1.0:1787842118.656611:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877561856 00000100:00100000:1.0:1787842118.656710:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787842118.656722:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382350b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16245:x1874687877561856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787842118.656830:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382350b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16245:x1874687877561856:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.656838:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787842118.656906:0:16245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16245:1874687877561856:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787842118.657627:0:16245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787842118.657697:0:16245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382352580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16245:1874687877561984:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787842118.657750:0:16245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842118.658551:0:16245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787842118.658655:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877561984 00000100:00100000:0.0:1787842118.658665:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877561984 00000100:00100000:0.0:1787842118.658896:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787842118.658909:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463823530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16245:x1874687877561984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787842118.659296:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463823530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16245:x1874687877561984:12345-0@lo:1000:mdt00_003.0 Request processed in 388us (1543us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787842118.659304:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787842118.659408:0:16245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382352580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16245:1874687877561984:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787842118.659446:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659564:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659573:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659579:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa19000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.659592:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659614:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659631:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:2.0:1787842118.659634:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787842118.659639:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659646:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19000/0x1d0ed3605e137554 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659675:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659680:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659684:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659686:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247000 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.659688:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659692:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659697:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.659699:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787842118.659756:0:16245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659775:0:16245:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659782:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.659805:0:16245:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7246600/0x1d0ed3605e1374b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x3730c03197d97f69 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.659813:0:16245:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463823521c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1874687877562112:192.168.202.46@tcp:105: 00000100:00100000:2.0:1787842118.660016:0:16245:0:(client.c:2715:ptlrpc_set_wait()) set ffff9464a77b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787842118.663561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.663787:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858702848 00000100:00100000:3.0:1787842118.663795:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858702848 00000100:00100000:3.0:1787842118.663848:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:3.0:1787842118.663858:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485014850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+19:14488:x1874687858702848:12345-192.168.202.46@tcp:49:dd.0 00000100:00100000:3.0:1787842118.664003:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485014850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+19:14488:x1874687858702848:12345-192.168.202.46@tcp:49:dd.0 Request processed in 146us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.664011:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10 00000100:00100000:2.0:1787842118.664538:0:16245:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463823521c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1874687877562112:192.168.202.46@tcp:105: 00010000:00010000:2.0:1787842118.664565:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664576:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464a7247000/0x1d0ed3605e1374ac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664622:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664636:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664648:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664657:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664675:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664679:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664683:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.664685:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.664690:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.665777:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.665784:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787842118.665791:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.665797:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946480030e00/0x1d0ed3605e13755b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.665938:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.665945:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.666012:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.666018:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa18800 already unused, calling callback (ffffffffc1e9c4f0) 00010000:00010000:2.0:1787842118.666036:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.666043:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.666056:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464999d2a00) 00010000:00010000:2.0:1787842118.666059:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787842118.666062:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.666067:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa18800/0x1d0ed3605e13754d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842118.666731:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:14489:x1874687858702592:12345-192.168.202.46@tcp:57:lhsmtool_posix.0 Request processed in 17230us (17604us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787842118.666741:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 53 00000020:00080000:2.0:1787842118.666746:0:16245:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787842118.669359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.669451:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703104 00000100:00100000:3.0:1787842118.669491:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703104 00000100:00100000:3.0:1787842118.669538:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11 00000100:00100000:3.0:1787842118.669546:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:14489:x1874687858703104:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787842118.670396:0:14371:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787842118.670516:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787842118.670565:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.670581:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.670606:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.670615:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.670621:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.670626:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842118.670649:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787842118.670748:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+20:14489:x1874687858703104:12345-192.168.202.46@tcp:35:lhsmtool_posix.0 Request processed in 1200us (1394us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787842118.670768:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11 00000020:00080000:3.0:1787842118.670774:0:14371:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787842118.671187:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787842118.671194:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.671211:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa19200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842118.671214:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.671223:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.671235:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946488a36d00) 00010000:00010000:2.0:1787842118.671238:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787842118.671252:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.671258:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfa19200/0x1d0ed3605e137562 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.671270:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842118.671271:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787842118.671272:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787842118.671808:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787842118.671821:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787842118.671852:0:14402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787842118.671857:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787842118.878781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.878946:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703232 00000100:00100000:2.0:1787842118.878969:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703232 00000100:00100000:2.0:1787842118.879046:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:2.0:1787842118.879057:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648cb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+7:2348:x1874687858703232:12345-192.168.202.46@tcp:4:dd.0 00002000:00010000:2.0:1787842118.879116:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a904e47, atime: 0x6a904e46, ctime: 0x6a904e47, blocks: 0x1 00010000:00010000:2.0:1787842118.879126:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.879143:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1787842118.879147:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842118.879154:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.879167:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.885038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1787842118.886677:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787842118.886695:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787842118.887184:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703360 00000100:00100000:3.0:1787842118.889121:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703360 00000100:00100000:2.0:1787842118.891741:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787842118.891762:0:16602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463820092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:2349:x1874687858703360:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:2.0:1787842118.891812:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.891829:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842118.891833:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842118.891840:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842118.891854:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842118.900164:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9463823521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877562240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787842118.900288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787842118.900597:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877562240 00000100:00100000:2.0:1787842118.900605:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877562240 00000100:00100000:2.0:1787842118.900662:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787842118.900673:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382009e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877562240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787842118.900709:0:15056:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787842118.900759:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382009e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874687877562240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842118.900767:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787842118.901687:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787842118.901735:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9463823521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1874687877562240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787842118.901894:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946382038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877562624:0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.901937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842118.901977:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787842118.901984:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877562752:0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.902006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787842118.902042:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877562624 00000100:00100000:1.0:1787842118.902048:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877562624 00000100:00100000:1.0:1787842118.902091:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877562752 00000100:00100000:1.0:1787842118.902095:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877562752 00000100:00100000:1.0:1787842118.902132:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787842118.902140:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877562624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.902205:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874687877562624:12345-0@lo:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.902212:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787842118.902228:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787842118.902235:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877562752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.902262:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649fd95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874687877562752:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.902268:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787842118.902289:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787842118.902308:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94649197e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1874687877562752:0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.902317:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946382038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1874687877562624:0@lo:400:kworker.0 00000100:00100000:3.0:1787842118.902608:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638203b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5153086-f7d7-4317-94f4-d9c880bce3b9:3306:1874687877562368:0@lo:400:kworker.0 00000100:00100000:3.0:1787842118.902653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842118.902692:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787842118.902699:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94638203a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877562496:0@lo:400:kworker.0 00000100:00100000:3.0:1787842118.902723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787842118.902749:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877562496 00000100:00100000:3.0:1787842118.902753:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877562496 00000100:00100000:3.0:1787842118.902780:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787842118.902787:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877562496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787842118.902819:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874687877562496:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842118.902826:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787842118.902853:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638203a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874687877562496:0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.904718:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687877562368 00000100:00100000:1.0:1787842118.904731:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687877562368 00000100:00100000:1.0:1787842118.904801:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787842118.904813:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3306:x1874687877562368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787842118.904902:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5153086-f7d7-4317-94f4-d9c880bce3b9+19:3306:x1874687877562368:12345-0@lo:400:kworker.0 Request processed in 92us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842118.904909:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787842118.905069:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94638203b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5153086-f7d7-4317-94f4-d9c880bce3b9:3306:1874687877562368:0@lo:400:kworker.0 00000100:00100000:3.0:1787842118.936040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.936075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.936093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.936102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.936109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842118.936121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1787842118.936228:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787842118.936237:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787842118.936337:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787842118.936346:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703488 00000100:00100000:2.0:1787842118.936354:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703488 00000100:00100000:2.0:1787842118.936411:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787842118.936416:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703616 00000100:00100000:2.0:1787842118.936419:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703616 00000100:00100000:2.0:1787842118.936430:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787842118.936432:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703744 00000100:00100000:2.0:1787842118.936434:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703744 00000100:00100000:2.0:1787842118.936439:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787842118.936489:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858703872 00000100:00100000:2.0:1787842118.936493:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858703872 00000100:00100000:2.0:1787842118.936512:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787842118.936518:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704000 00000100:00100000:2.0:1787842118.936521:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704000 00000100:00100000:2.0:1787842118.936532:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787842118.936536:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704128 00000100:00100000:2.0:1787842118.936539:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704128 00000100:00100000:1.0:1787842118.938067:0:16603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:1.0:1787842118.938080:0:16603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382008b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3b1cec3-3bee-4317-891b-62987a7c0b89+16:2349:x1874687858703488:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:1.0:1787842118.938117:0:16603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.938137:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842118.938141:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787842118.938147:0:16603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787842118.938159:0:16603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787842119.075039:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1787842119.075060:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1787842119.075067:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1787842119.081038:0:15058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787842119.081049:0:15058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1787842119.081064:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081080:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081087:0:15058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081094:0:15058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842119.081098:0:15058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081107:0:15058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081132:0:15058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081140:0:15058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e137569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842119.081282:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648cb2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+18:2348:x1874687858703232:12345-192.168.202.46@tcp:4:dd.0 Request processed in 202221us (202506us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787842119.081294:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 0 00000100:00100000:2.0:1787842119.081333:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:2.0:1787842119.081347:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638200a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+17:2348:x1874687858703616:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:2.0:1787842119.081385:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081399:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787842119.081403:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842119.081411:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.081423:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787842119.174401:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1787842119.174428:0:16603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00010000:00010000:3.0:1787842119.174449:0:16603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174483:0:16603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174493:0:16603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174517:0:16603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464a7247400 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787842119.174523:0:16603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174533:0:16603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174555:0:16603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174564:0:16603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260a11e6/0x1d0ed3605e137577 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842119.174665:0:16603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382008b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3b1cec3-3bee-4317-891b-62987a7c0b89+15:2349:x1874687858703488:12345-192.168.202.46@tcp:4:dd.0 Request processed in 236584us (238629us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787842119.174680:0:16603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2 00000100:00100000:3.0:1787842119.174710:0:16603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4 00000100:00100000:3.0:1787842119.174721:0:16603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946382009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:2348:x1874687858703744:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:3.0:1787842119.174752:0:16603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174765:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787842119.174769:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787842119.174775:0:16603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.174799:0:16603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175242:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175253:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175261:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175281:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030200 already unused, calling callback (ffffffffc147e500) 00010000:00010000:2.0:1787842119.175284:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175292:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175303:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175311:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb6e568/0x1d0ed3605e137570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787842119.175356:0:16602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463820092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+14:2349:x1874687858703360:12345-192.168.202.46@tcp:4:dd.0 Request processed in 283601us (290329us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787842119.175364:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1 00000100:00100000:2.0:1787842119.175383:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5 00000100:00100000:2.0:1787842119.175391:0:16602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+13:2348:x1874687858703872:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:2.0:1787842119.175408:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175417:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842119.175420:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787842119.175424:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787842119.175443:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.220077:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787842119.286891:0:15058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1787842119.286901:0:15058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787842119.286917:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.286931:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.286951:0:15058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.286968:0:15058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842119.286973:0:15058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.286984:0:15058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.287004:0:15058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.287031:0:15058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cec037a/0x1d0ed3605e13757e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842119.287133:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638200a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+17:2348:x1874687858703616:12345-192.168.202.46@tcp:4:dd.0 Request processed in 205787us (351050us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787842119.287148:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3 00000100:00100000:0.0:1787842119.287182:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6 00000100:00100000:0.0:1787842119.287193:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638226e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+16:2348:x1874687858704000:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:0.0:1787842119.287228:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.287241:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842119.287245:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842119.287252:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.287263:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787842119.287392:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:2.0:1787842119.387182:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1787842119.387201:0:16603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1787842119.387207:0:16603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00000001:00080000:2.0:1787842119.387208:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:0.0:1787842119.387227:0:16603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387263:0:16603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387271:0:16603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387278:0:16603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfa18a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842119.387282:0:16603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387292:0:16603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387311:0:16603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387318:0:16603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003066120c/0x1d0ed3605e137585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842119.387418:0:16603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946382009680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3b1cec3-3bee-4317-891b-62987a7c0b89+12:2348:x1874687858703744:12345-192.168.202.46@tcp:4:dd.0 Request processed in 212694us (451316us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787842119.387429:0:16603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4 00010000:00010000:3.0:1787842119.387474:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.387484:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842119.387490:0:16603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7 00010000:00010000:3.0:1787842119.387491:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.387496:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787842119.387499:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842119.387502:0:16603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7234f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3b1cec3-3bee-4317-891b-62987a7c0b89+11:2349:x1874687858704128:12345-192.168.202.46@tcp:4:dd.0 00010000:00010000:3.0:1787842119.387507:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.387517:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.387523:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2696a8e/0x1d0ed3605e13758c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387535:0:16603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.387550:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842119.387554:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787842119.387560:0:16603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842119.387566:0:16602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b7ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3b1cec3-3bee-4317-891b-62987a7c0b89+10:2348:x1874687858703872:12345-192.168.202.46@tcp:4:dd.0 Request processed in 212177us (451462us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787842119.387572:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5 00010000:00010000:0.0:1787842119.387572:0:16603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787842119.436127:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1787842119.436317:0:15058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1787842119.436323:0:15058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1787842119.436338:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.436352:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.436361:0:15058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.436369:0:15058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485481a00 already unused, calling callback (ffffffffc147e500) 00010000:00010000:0.0:1787842119.436374:0:15058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.436384:0:15058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.436428:0:15058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787842119.436438:0:15058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c4ad12/0x1d0ed3605e137593 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787842119.436563:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638226e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+9:2348:x1874687858704000:12345-192.168.202.46@tcp:4:dd.0 Request processed in 149369us (500446us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787842119.436573:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6 00000001:00080000:1.0:1787842119.537784:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1787842119.538211:0:16603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1787842119.538239:0:16603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.538253:0:16603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.538262:0:16603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.538268:0:16603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946485480600 already unused, calling callback (ffffffffc147e500) 00010000:00010000:3.0:1787842119.538273:0:16603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.538282:0:16603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.538300:0:16603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787842119.538308:0:16603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000552e67ec/0x1d0ed3605e13759a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787842119.538430:0:16603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7234f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2349:x1874687858704128:12345-192.168.202.46@tcp:4:dd.0 Request processed in 150927us (602300us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787842119.538442:0:16603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7 00010000:00010000:2.0:1787842120.242101:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787842121.119398:0:16641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787842121.266841:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787842122.008784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.008862:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.008901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.008920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.008937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.008958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.008983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1787842122.009007:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704768 00000100:00100000:3.0:1787842122.009019:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704768 00000100:00100000:3.0:1787842122.009081:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704384 00000100:00100000:3.0:1787842122.009084:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704384 00000100:00100000:3.0:1787842122.009106:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:3.0:1787842122.009116:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a72370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea7232b-897d-4d0d-a388-928bbad7f439+6:2347:x1874687858704768:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787842122.009218:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a72370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea7232b-897d-4d0d-a388-928bbad7f439+6:2347:x1874687858704768:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842122.009225:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 31 00000100:00100000:3.0:1787842122.009242:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:3.0:1787842122.009250:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a72361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+20:2347:x1874687858704384:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787842122.009279:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a72361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+20:2347:x1874687858704384:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842122.009285:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 32 00000100:00100000:3.0:1787842122.009317:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704512 00000100:00100000:3.0:1787842122.009320:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704512 00000100:00100000:3.0:1787842122.009338:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858705024 00000100:00100000:3.0:1787842122.009340:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858705024 00000100:00100000:3.0:1787842122.009350:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704640 00000100:00100000:3.0:1787842122.009352:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704640 00000100:00100000:3.0:1787842122.009363:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704896 00000100:00100000:3.0:1787842122.009365:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704896 00000100:00100000:3.0:1787842122.009380:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:3.0:1787842122.009386:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2347:x1874687858704512:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1787842122.009413:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2347:x1874687858704512:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842122.009419:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 16 00000100:00100000:3.0:1787842122.009430:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 17 00000100:00100000:3.0:1787842122.009436:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea7232b-897d-4d0d-a388-928bbad7f439+5:2347:x1874687858705024:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787842122.009595:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787842122.009606:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787842122.009720:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:2.0:1787842122.009728:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a72343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2347:x1874687858704640:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787842122.009756:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a72343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3b1cec3-3bee-4317-891b-62987a7c0b89+5:2347:x1874687858704640:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842122.009762:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 18 00000100:00100000:2.0:1787842122.009773:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787842122.009780:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:2.0:1787842122.009786:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464a7236d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2347:x1874687858704896:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1787842122.009806:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7236d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea7232b-897d-4d0d-a388-928bbad7f439+5:2347:x1874687858704896:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 21us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787842122.009812:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 19 00000100:00100000:1.0:1787842122.009958:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687858704256 00000100:00100000:1.0:1787842122.009964:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687858704256 00000100:00100000:1.0:1787842122.010007:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 124 00000100:00100000:1.0:1787842122.010016:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464badb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2347:x1874687858704256:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1787842122.010049:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464badb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56d8499e-fbef-4bb1-ad4e-0afe3a072b32+13:2347:x1874687858704256:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 34us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787842122.010056:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 124 00000100:00080000:1.0:1787842122.010095:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787842122.010099:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787842122.010101:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787842122.014033:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464a7234b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea7232b-897d-4d0d-a388-928bbad7f439+5:2347:x1874687858705024:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 4579us (5094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787842122.014051:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 17 00010000:00010000:3.0:1787842122.292021:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30121 lines, 30121 kept, 0 dropped, 0 bad.